Is Flyway support for Hive in 7.0.0 Release? Looked like it was being worked on in:
https://github.com/flyway/flyway/issues/142
and
https://github.com/flyway/flyway/pull/1322/files
Hive is not in the 7.0.0 release. We currently have no plans to add support for this database. To read more see our policy for adding support https://flywaydb.org/documentation/contribute/contributingDatabaseSupport#why-doesnt-flyway-accept-all-database-support-contributions
Related
I'm just wondering if the app supports mssql. I found datasource configuration for H2 and PostgreSQL but non for other datasources supported by Quarkus.
Optaweb-employee-rostering is a rich example application that shows how the employee rostering problem can be solved with OptaPlanner. As such, users are expected to take inspiration from it and change the app as they need.
If you want to try the app with MS SQL, replace a JDBC driver dependency:
https://github.com/kiegroup/optaweb-employee-rostering/blob/main/optaweb-employee-rostering-backend/pom.xml#L81-L84
and change the Quarkus profile:
https://github.com/kiegroup/optaweb-employee-rostering/blob/main/optaweb-employee-rostering-backend/src/main/resources/application.properties#L24-L28
The Quarkus profile can be activated during the build by specifying the quarkus.profile maven property, e.g.:
mvn clean install -Dquarkus.profile=postgres
I have just started using TOSCA. Currenly using version 11.2.
I would like to ask can we integrate TOSCA with github to store the repository?
if yes, then how can we do it?
which version to use for this ?
I would suggest using the latest version available and then connect to GitHub as described here: https://support.tricentis.com/community/manuals_detail.do?lang=en&url=tosca_commander/github.htm
I am using an EMR cluster to develop/run Spark jobs. Now I need to access Kinesis and need to install spark-sql-kinesis_2.11-2.2.0.jar. I am not very clear on how to do that yet. Any pointer/experience will be very helpful
I ended up building it myself from the source code (github) and then specified it in my spark-submit code. That seems to be recommended.
The latest version of Impala that I can find an EMR bootstrap action This one this is from 2015 and installs Impala 2.2.0
Is there an easy way to update this to 2.7 or 2.8? Spinning up an Ubuntu 14.04 box to do a build is one option, but I'm unclear how to ultimately install it on an EMR cluster.
As this moment, there is no documented script to easily update impala to work on EMR. Its a sys admin thing and yes, you might look at the install script and tweak it to include your own build. Also, make sure you have all dependencies.
Once you install it, you will need to ensure you have relevant configuration files placed somewhere in the CLASSPATH established by set-classpath.sh for Impala's use of EMR's HDFS, HBase , Hive metastore or S3 .
I am trying to migrate a legacy mapreduce pipeline that is using ami 3.x to ami 4.x. It currently has bash scripts as part of the bootstrapping and one of them calls hadoop fs-get s3n://somefile ~/otherfile. This fails in my current migration attempt to ami 4.x. And adding ls /home/hadoop/bin the script shows that the directory /home/hadoop/bin does not exist so of course the binary /home/hadoop/bin/hadoop would not exist. Is there something I need to configure to ensure the hadoop binary exists? I can't seem to find anything obvious in the documentation.
The file system layout changed considerably between 3.x and 4.x. The differences between 3.x and 4.x and instructions for migrating can be found here: http://docs.aws.amazon.com/ElasticMapReduce/latest/ReleaseGuide/emr-4.1.0/emr-release-differences.html
The short answer for solving your issue though is that you should use "aws s3 cp" instead of "hadoop fs-get" in bootstrap actions, since Hadoop is not installed until after bootstrap actions run on 4.x+.