As the title suggest, I want to merge my Azure table data with the data residing in Azure SQL. However, I dont want to replicate Azure SQL data to Azure table.
Anyway to have the Azure table in SSMS and then I could create a view over Azure table and Azure SQl together?
Azure Table Storage is not a relational database and does not support join query. To join existing data in Azure SQL Database with data on Azure Table Storage, you will have to replicate/import your data in Azure Table Storage into Azure SQL, and then use SSMS to perform the join. That's the only solution.
Elastic Database queries on Azure SQL Database allows cross database queries involving Azure Database tables or Azure SQL Data Warehouse tables only.
What you want for something like this is Elastic Query. You can read more about it here. Pay attention to the warning about data movement though. This is good for querying, but it's not a great way to do large scale data moves.
Related
I'm trying to access Azure Table Storage in a Gen 2 data lake from Azure SQL Server, but I can't find any documentation. Loads on how to get to csv's in blob storage, but nothing on Azure tables.
Any ideas?
John
Your requirement isn't feasible.
Azure Table storage is a service that stores non-relational
structured data (also known as structured NoSQL data) in the cloud,
providing a key/attribute store with a schemaless design.
Since, Table storage can't be queried using SQL, therefore there is no sense to access it using any SQL Server.
I recommend you to first go through Table storage concepts
before knowing how to query it.
Once getting the Table Storage structure, you can query the tables either through REST API or Cosmos DB Table API based on your application. Refer Querying tables and entities.
You can also follow this complete tutorial Quickstart: Build a Table API app with .NET SDK and Azure Cosmos DB to create basic application using Table Storage for learning purpose.
I have a situation where most of my organization's data sits at Azure SQL. Now we are including one more data source which gives 1GB of structured data daily. My objective is that I have to merge this 1GB with the Azure SQL data and give it to the PowerBI. I can't do this on PowerBi because it is slow.
Now should I choose CosmosDB as a sink and replicate some of the Azure SQL tables to CosmosDB?so that I will have stored procedure at cosmos which does the required merge and places it in the final tables at cosmos for PowerBi to pick up.
Or should I choose some other sink? (I can have appendblob but it has a 200GB upper limit. I can have Azure table storage but then how can I merge with Azure SQL data?
Any recommendations on what to do?
I am going to create a SQL tables in Azure SQL database, and I want to create a partition of table, but I don't know how to do that, can any one show me some demo example or query to perform this. I am using SQL management studio to connect my Azure db.
We take advantage of partitioning SQL Azure tables. We use it so we can rapidly truncate the oldest partitions of data.
We have a great blog post that walks through step by step how to do it:
https://stackify.com/how-to-partition-tables-in-azure-sql/
I know this is an old post but this may help:
https://www.mssqltips.com/sqlservertip/3494/azure-sql-database--table-partitioning/
I'm not sure what your use case is but Elastic Database Tools for Azure SQL Database allow you to implement sharding if you are partitioning the table because of its size.
https://learn.microsoft.com/en-us/azure/sql-database/sql-database-elastic-scale-introduction
It seems data lake analytics has a support to create databases but can we create relational databases too?
Each Azure Data Lake Analytics account can create databases that can contain relational data that you can create, manage and query with U-SQL.
That data is stored in a scaled out fashion inside the Azure Data Lake Storage. So in a sense it is creating relational databases.
However it does not give you the ability to create a SQL Server or Oracle or MySQL database.
Can we sync views on local database with tables on SQL azure database using SQL Azure Datat Sync[Preview]? If yes, then how?
In my opinion, the jury is still out on SQL Azure Data Sync. It's been in preview for years and still is.
When you say sync, and you looking to take the results of a local view and persist them as a table in SQL Azure?
If so, you can create a SELECT INTO, taking the data from the local view and letting the SELECT INTO make a table out of it. There are some things you need do to make the SQL Azure DB available locally:
http://msdn.microsoft.com/en-us/library/azure/ee336282.aspx
https://dba.stackexchange.com/questions/59328/insert-to-sql-azure-through-linked-server-very-slow