My organisation is using RabbitMQ and ELK to collect and analyst log information. we also use WSO2 API Manager (1.10.0) as gateway and need to send log of AM to RabbitMQ somehow. Could anyone please give some advices on how to achieve or show me where the related documents are available. I found a fabulous article for publishing WSO2 carbon logs to ELK, https://udaraliyanage.wordpress.com/2016/06/19/publish-wso2-carbon-logs-to-logstashelasticsearhkibana-elk-using-log4j-socketappender/, but cannot find how to send logs to RabbitMQ.
Thanks,
Sean
AFAIK there is no out of the box method to publish logs to RabbitMQ.
But wso2 carbon allows adding custom log appenders. So you can write your own log4j appender (this is an example for a Rabbitmq log appender). After that add it to the wso2 product's log4j properties. You can follow this guide to write and add your own log4j appender to the wso2 product.
Hope this helps.
Related
Recently I installed Rabbit MQ in Centos8 for my company. We also using Splunk Enterprise so we wants to integrate our Rabbit MQ to Splunk and we wants to see, search, check our logs which is coming from Rabbit MQ to in Splunk . How can I do that I don't know. I google it but I didn't get info about it. May anybody help to me for this goal ? Thank you
The scripts at https://github.com/jerrykuch/rabbitmq-splunk are somewhat old, but should still be functional. It can leverage the HTTP API to pull in the relevant data. That page also lists the recommended files to monitor
Always check Splunkbase when looking for ingesting data types - often there exist apps and add-ons that will do what you're looking for
Here are two related to RabbiMQ:
JMS Messaging Modular Input - https://splunkbase.splunk.com/app/1317/#/details
AMQP Messaging Modular Input - https://splunkbase.splunk.com/app/1812/#/details
I have ingestion pipeline source --> ActiveMQ --> Storm --> HDFS.
Now I want to monitor ActiveMQ queue so as to detect failures and send email to concerned person.
I haven't used it before so I'm looking at options that can be used for monitoring these queues.
Can somebody suggest suitable tools ?
See http://activemq.apache.org/how-can-i-monitor-activemq.html. But here you only see information how to access the data.
With the jolokia interface you have a REST api which access all jmx values.
Check for existing monitoring application you already have and let's see if they can do REST requests or jmx. E.g. you could use Graphite, Kibana, monitis.
IN the following link:
http://www.mulesoft.org/documentation/display/current/Mule+ESB+3.4.0+Release+Notes
I see the following
EE-3141 When using a Throttling policy with throttling statics enabled, limit headers are swapped.
However, I can find no example of throttling policies within Mule ESB, but there is possibly a throttling policy within the Anypoint API Manager
Could someone please provide a link to how to use a Throttling policy within Mule ESB?
Thanks
To achieve correct Throttling behaviour you can follow below steps:
Configure a queue (for example, a persistent VM or a JMS queue to avoid message lost during the Mule server crash) after your inbound endpoint.
Configure scheduled delay, for example AMQ_SCHEDULED_DELAY in case of ActiveMQ, to a desired value. If the queue does not support scheduled delay, then we need to find our way to achieve the delay, probably using a Java component.
Finally, configure the outbound endpoint.
The Throttling module (which can be configured as throttler or rate limiter) comes out of the box with any Mule API Gateway distribution. Mule EE comes with a light weight version of it. If you are using Anypoint API Platform, then you don't need to pay attention to the internals of how it is being done: Simply apply/unapply the policy to your managed API and it will work like a charm.
Even i tried implementing the Throttling concept in mule flows. There is no exact way of implementation for this , but i was able get that nature into the flows using the receiver thread profiling at inbounds and dispatch threading profiles on outbound connectors.
I have gone through the documentation of how we can integrate mule esb with mule mq. But i couldn't find any download link for mule MQ. Even i read on mule blog the mule mq is out of market now. Can anybody comment on this.
below are the ref links
http://www.mulesoft.org/documentation-3.2/display/MULE2USER/MuleMQ+Integration
http://forum.mulesoft.org/mulesoft/topics/where_to_get_mule_mq_software
MuleSoft has completely abandoned MuleMQ. Use another message broker, like HornetQ, ActiveMQ or RabbitMQ.
Mule MQ is now totally deprecated.But it provides a seamless integration between various MOM which utilized JMS and other tools.
By default, Mule provides a JMS endpoint that can be used to send and receive messages using JMS API.
We can prefer the queuing vendors based upon two need
1.AMQP
Advanced Message Queuing Protocol,which provides so many advanced features in queue to provide the routing needs.RabbitMQ,ActiveMQ etc..
2.MSMQ
MSMQ is MOM provided by Microsoft as a component.If required it can be enabled from Turn Windows Features On or Off.It doesn't implements much features that AMQP provide.It also doesn't have a topic feature which is available in MSMQ.
I hope this answer helps you.
Thanks and Regards
As of now Mule MQ is discontinued, You can user other third party Queue broker solutions like - RabbitMQ, ActiveMQ.
I've got a streaming UDP application that generates a stream of messages in a legacy format. These messages are generated in an un-solicited fashion (that is, it is not request/response).
I'd like to build a custom message mediator to take these messages into an enterprise network.
Can someone please point me to one or more samples in the WSO2 ESB portfolio that are a good starting point for building a custom mediator?
Any other samples, or examples, to serve as a starting point for a WSO2 ESB novice that needs to develop his first custom mediator would be appreciated.
You can refer these links.
(Creating a project by userself and compile a custom mediator jar)
http://docs.wso2.org/wiki/display/ESB460/Writing+a+WSO2+ESB+Mediator
(Using WSO2 Developer studio)
http://achala11.blogspot.com/2012/12/how-to-write-custom-mediator-wso2-esb.html