Syslog-ng custom parser - syslog-ng

Is it possible to implement custom parsers in syslog-ng ? For example, I want to implement a custom parser which will parse messages in ASN format and write the contents of the message to a file in ASCII format. Would it be possible ?

yes, you can write custom parsers in Python. The Python parser is available in the latest version of the Premium Edition (commercial product), and it will be available in the upcoming 3.10 version of the Open Source Edition.
You can read about it in the documentation of the Premium Edition at https://www.balabit.com/documents/syslog-ng-pe-latest-guides/en/syslog-ng-pe-guide-admin/html/python-parser.html
If you compile the current master branch of the Open Source Edition, it should include the Python parser. I think there is also a nightly rpm package somewhere that includes it - I'll check it and get back to you tomorrow.

Related

Cognos Data Manager to Cognos Datastage Migration

I'm looking at a migration project to migrate a client from Datamanager to Datastage. I can see that IBM have helpfully added in the Migration Assistant tool, but less helpfully, I cannot find any details on how to actually use it.
I did use it some years ago, and I'm aware that you need to do it in a command line interface and it works by taking an extract file and creating a Datastage job out of it, which is then reinstalled. However I haven't got my notes any more from that process.
If there is a user guide out there for this tool, I'd love to see it.
Cheers
JK
Your starting point would be the IBM support page and then see "How to download the tool" and ensure you have the required version (10.2.1 + Fix Pack 13 + Interim Fix) installed. The user guide PDF is part of the install in the sub-folder "datamanager/migration".

Use java 8 features (newer janino version) in pentaho data integration

Pentaho Data Integration 8.0.x is using Janino 2.5.16, released in 2010 for compiling the User Defined Java Class step. There is a JIRA in pentaho for updating this to use a newer Janino version which would bring new java 8 related features in pentaho v8.2.0 GA. But there is no info on when will this be released.
Is there any other way I can use a newer janino version (janino-3.0.8.jar) with exiting pentaho for UDJC? I tried to copy updated jar in the lib and also added commons-compiler-3.0.8.jar to fulfill dependency. Now when I open Spoon, I get the following error:
Please advise on how this can be achieved. I understand that just replacing the jar may not be enough but just want if something else can be done.
This is not easy. Even now, since you got ClassNotFound, public api of janino is changed. Some classes are removed some are changed. What is actual needs to update it?
If you need really complicated business logic, then create custom plugin. Documentation and tutorials are available and you can look into sources of current builtin plugins (sources are available on github).
What important new version of janino has, that old doesn't (beside java8 support)? Checkout kettle engine, look into sources of UserDefinedClass step, change code to support new janino version, test and make own build of pdi kettle, and try to send push request to maintainers of repository.
Any of this quite complicated, This plugin is builtin into engine, and you have to make own build. Own build means, you have to support it by yourself. This is non trivial, project is huge and now even bigger and continue evolving, I spent several days to make my first custom build (version of 4, was in ivy) just for purpose to know better and debug complicated cases, and it used never in production.
Maintainers of repository must have good reason to include your changes into stream, it must be well tested and it is long procedure and most probably doesn't worth it. A lots of changed since 2010, I probable have seen in release notes, new version of java already have abilities to compile at runtime.
My advice is to make you own plugin.

Where Can I Download the Summer 18 version of the Salesforce Migration Tool?

I am trying to download the latest version of the force.com migration tool (sometimes called the ANT migration tool.)
The download page seems to link to the Summer 2016 version of the tool (see errors below), despite claiming to link to the Summer 2018 version.
When I configure package.xml and run the .jar like so:
ant retrieveUnpackaged -lib path/to/ant-salesforce.jar
I get errors like this:
[sf:retrieve] package.xml - API version Summer '16 does not have access to Lightning Pages of type CommObjectPage
Note that this error message is not referring to the API version in the retrieve source sandbox. The sandbox API version is Winter '19.
I've been looking for a while now and still haven't found an alternative download link that correctly points at the Summer 2018 migration tool. Can anyone help?
Based on the error message, it sounds like the error message is complaining about the version number indicated in the retrieve package manifest, rather than the version of the migration tool.
If you go in the file named package.xml, there should be a tag <version>37.0</version>. If you change the number to anything 38.0 or higher, I would think the retrieve call should work for you.

How to I install OpenRefine extensions in OntoRefine

Is it possible to use OpenRefine extensions in OntoRefine (part of GraphDB 8.3)? And if yes, how?
What version of OpenRefine is OntoRefine based on?
GraphDB support replied to my e-mail:
OntoRefine is currently (dec 2017) based on OpenRefine 2.5
The implementation is packaged in app/lib/workbench/WEB-INF/lib/graphdb-framework-openrefine-{version}.jar
In my case, GraphDB version is 8.3.1 and the installer placed it into C:\Users\\AppData\Local\GraphDB Free\ (on Windows)
So theoretically, it is possible to unpack the graphdb-framework-openrefine-8.3.1.jar file, add a plugin, repackage and replace.
In practice, it's just too much work and it's probably easier to use a standalone OpenRefine and export from there into GraphDB.

TestNG XSLT (Saxon) Report Generator Jars

I am trying to generate XSLT file using TestNG + Selenium + Java.
I find out that to do so , we need to have these three jar files
saxon-8.7.jar
SaxonLiaison.jar
testng-xslt-maven-plugin-test-0.0.jar
I got those files from separated sources and mostly from someone's personal repository.
Is there any official webpage to download the latest version of those three jar files?
I went to Saxon Page and apparently we need to pay to use Saxon product? Not sure if I am on the right page though.
Are those 3 Jar files mentioned above free of charge? Thanks.
I can answer part of the question.
I don't know if testNG/Selenium really requires Saxon 8.7 specifically (that's a very old version) or whether it will also run with more recent versions. Sometimes when people say the requirement is for version X, they simply mean that's the one that it was tested with. Either way, I think it almost certainly requires only the open source version of Saxon (which was called Saxon-B up to version 9.1, and Saxon-HE from versions 9.2 to the current 9.7). For all the open-source versions, the official distribution is on the Saxon project at Sourceforge, https://sourceforge.net/projects/saxon/files/ Obviously, for these versions no license (or payment) is required.
The page you cite from www.saxonica.com is only relevant to commercial versions of Saxon. I guess we should correct it, because we should allow for users landing there from a google search and therefore not assume any context.
I can't help you on the other two JAR files.