How do I transfer Sqlite data to Mysql using Pentaho Data Integration(PDI)? - pentaho

Hi so I have a webApp on local server that writes in a sqlite database. I want to transfer this data from Sqlite server to Mysql server.
How do I do that using Spoon, pentaho.

it's a simple task
create two database connection first one is sqlite and second one is mysql.
after that add table input step for sqlite connection. add table output for mysql connection in transformation.

Related

How to insert table between 2 server in Azure data warehouse?

I want to insert table from different factory / server in Azure data warehouse. Is it possible to insert by query?
Because it takes a lot of time if I make dataset and pipeline for each table in Azure data factory.
Just from your screenshot, according the icon of the Azure SQL, you're using Azure SQL database, not Azure Data Warehouse.
You could use Elastic Query to do a cross database query in Azure.
Ref the tutorial: Get started with cross-database queries (vertical partitioning) (preview)
Elastic database query (preview) for Azure SQL Database allows you to run T-SQL queries that span multiple databases using a single connection point. This article applies to vertically partitioned databases.
When completed, you will: learn how to configure and use an Azure SQL Database to perform queries that span multiple related databases.
Then you can inset data from external table to current database table.
Note: Azure SQL database already has the master key, you don't need create it again.
Hope this helps.

SQL Server Merge with two tables from different azure SQL Database from same Azure SQL SERVER

I need to merge with 2 different tables from 2 different azure SQL databases where as these two azure sql database are from same azure sql server.
also for performance imporvement purpose, what I need to do is bulk insert and/or bulk update. also, this will be continous activity. for very first time I have to merge all data which is huge. and then whenever respective topic recivies message, I need to add/update that single record only.
what are the different options to do the same. for both processes.
please help. thanks.
You can use Azure SQL Data Sync to merge those tables located on 2 different databases into a third and new database. You just need to create the table with no records, then use Azure SQL Data Sync with one-way sync from those 2 databases (member databases) to the newly created table on the new database (hub database). On the first sync data will be merged on the new table located on the hub database. Every time a record gets updated, deleted or new record arrive on the member databases then that data change is replicated to the hub database and to the merged table.
To know more about the free Azure SQL Data Sync please read here.

How can i Dump the generated sql data into my local postgres?

As an example how want to know how i can migarte my sql data that i previously made a sql dump for my db but now i want to dump the generated sql data into my local postgres

Create/Update Postgresql table via Microsoft SSIS package

I want to do the following two things:
Create a table "Lite AC" with two columns (id, lite_ac) in a Postgresql database via Microsoft SSIS package
Update that newly created table via another SSIS package
I want to use that table in order to integrate it into a WHERE SUBSTRING IN (Lite AC) statement.
I am using pgAdmin to connect with that Postgresql database. I know how I can export data from Postgreql via an SSIS package so all the drivers should be installed, but no idea how to do that the other way round.
Is that possible?
I do not have Postgres installed.
You need two connection managers. One for source and the other for destination.
In your case destination is Postgres DB. In order to test out, you may use a Flat File Connection to insert set of sample data from a .txt file. Following tutorial emphasizes on Login credentials to Postgres DB.
Install the relevant drivers (32bit and 62bit accordingly)
Follow this tutorial
Once you are able to connect to Postgres DB via SSIS and rows are inserted into the DB using .txt file - try to add a SQL Scripting Task to be executed after Data Flow Task, so to update the records in the new table.

Best Approach for migrating data from Access to SQL Server in SSIS

Please Let me know if any best approach available for these two SSIS Activities.
migrating access data to SQL Server table
multiple Access dbs are used as a source to migrate the data into a SQL table.
SQL server table to SQL server table
Is this a one time job that should it be done periodically?
If one time job, then you can use SQL server Import Data utility to accomplish both things easily.
If it is just copy of data from source to destination without any modification to data, then there is no need to use SSIS.
Use the SQL server Import and export wizard, at the end don't click on run now, and save the package , you can schedule these packages to do the same for you,
Yes you can copy from access to SQL table, and from SQL table to SQL table.
http://msdn.microsoft.com/en-us/library/ms140052%28v=sql.105%29.aspx