I have trouble in copying table data and structure to another table since I want to keep the Id column of Identity column and keep its oridinal value instead of starting from 1
I use below sql to insert all data except the ID column from MY_TABLE to MY_TABLE_NEW since it has error saying that
Only when the column list is used and IDENTITY_INSERT is ON, an explicit value can be specified for the identity column in the table'My_TABLE_NEW'.
But I have set it like below SQL:
IF NOT EXISTS (select * from sys.objects where name = 'My_TABLE_NEW')
BEGIN
CREATE TABLE [dbo].[My_TABLE_NEW]
(
[ID] [int] IDENTITY(1,1) NOT NULL,
[OBJECT_ID] [int] NOT NULL,
[YEAR_MONTH] [int] NOT NULL,
CONSTRAINT [PK_My_TABLE_NEW]
PRIMARY KEY CLUSTERED ([ID] ASC)
WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF,
IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON,
ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
) ON [PRIMARY]
END
GO
IF EXISTS (SELECT * FROM sys.objects WHERE name = 'My_TABLE_NEW')
BEGIN
SET IDENTITY_INSERT My_TABLE_NEW ON
INSERT INTO My_TABLE_NEW
SELECT [ID]
,[OBJECT_ID]
,[YEAR_MONTH]
FROM My_TABLE
SET IDENTITY_INSERT My_TABLE_NEW OFF
END
GO
What is the problem?
Try your insert with the column names:
INSERT INTO My_TABLE_NEW ([ID], [OBJECT_ID], [YEAR_MONTH])
SELECT [ID]
,[OBJECT_ID]
,[YEAR_MONTH]
FROM My_TABLE
From the documentation:
When an existing identity column is selected into a new table, the new column inherits the IDENTITY property, unless one of the following conditions is true:
The SELECT statement contains a join, GROUP BY clause, or aggregate function.
Multiple SELECT statements are joined by using UNION.
The identity column is listed more than one time in the select list.
The identity column is part of an expression.
The identity column is from a remote data source.
That means you can copy the table with SELECT INTO while retaining the identity column and can just add the PK after.
SELECT *
INTO My_TABLE_NEW
FROM My_TABLE
Here is a demo with fiddle.
You can use the built-in tool sp_rename for this, as long as you are just renaming the table not trying to create a copy of it.
EXEC sp_rename 'My_TABLE', 'My_TABLE_NEW'
GO;
https://learn.microsoft.com/en-us/sql/relational-databases/system-stored-procedures/sp-rename-transact-sql?view=sql-server-ver15
If you want to create a copy, then you just have to do the following:
SELECT *
INTO My_TABLE_NEW
FROM My_TABLE
Note: If you do this, you will have to re-add any key constraints, computed value columns, etc.
I have the following tables:
CREATE TABLE [dbo].[articles](
[ID] [int] IDENTITY(1,1) NOT NULL,
[name] [nvarchar](200) NOT NULL,
CONSTRAINT [PK_articles] PRIMARY KEY CLUSTERED
(
[ID] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
) ON [PRIMARY]
GO
✓
CREATE TABLE [dbo].[test_users](
[ID] [int] IDENTITY(1,1) NOT NULL,
[GUID] [nvarchar](100) NOT NULL,
CONSTRAINT [PK_test_users] PRIMARY KEY CLUSTERED
(
[ID] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY],
CONSTRAINT [unique_guid] UNIQUE NONCLUSTERED
(
[GUID] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
) ON [PRIMARY]
GO
✓
CREATE TABLE [dbo].[relational](
[ID] [int] IDENTITY(1,1) NOT NULL,
[articleid] [int] NOT NULL,
[userguid] [nvarchar](100) NOT NULL,
CONSTRAINT [PK_relational] PRIMARY KEY CLUSTERED
(
[ID] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
) ON [PRIMARY]
ALTER TABLE [dbo].[relational] WITH CHECK ADD CONSTRAINT [FK_relational_articles] FOREIGN KEY([articleid])
REFERENCES [dbo].[articles] ([ID])
ALTER TABLE [dbo].[relational] CHECK CONSTRAINT [FK_relational_articles]
ALTER TABLE [dbo].[relational] WITH CHECK ADD CONSTRAINT [FK_relational_relational] FOREIGN KEY([userguid])
REFERENCES [dbo].[test_users] ([GUID])
ALTER TABLE [dbo].[relational] CHECK CONSTRAINT [FK_relational_relational]
GO
✓
CREATE TABLE [dbo].[seperated](
[ID] [int] IDENTITY(1,1) NOT NULL,
[userguid] [nvarchar](100) NOT NULL,
[articles] [nvarchar](max) NOT NULL,
CONSTRAINT [PK_seperated] PRIMARY KEY CLUSTERED
(
[ID] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
) ON [PRIMARY] TEXTIMAGE_ON [PRIMARY]
ALTER TABLE [dbo].[seperated] WITH CHECK ADD CONSTRAINT [FK_seperated_test_users] FOREIGN KEY([userguid])
REFERENCES [dbo].[test_users] ([GUID])
ALTER TABLE [dbo].[seperated] CHECK CONSTRAINT [FK_seperated_test_users]
GO
✓
SET IDENTITY_INSERT [dbo].[test_users] ON
INSERT [dbo].[test_users] ([ID], [GUID]) VALUES (1, N'guid1')
INSERT [dbo].[test_users] ([ID], [GUID]) VALUES (2, N'guid2')
INSERT [dbo].[test_users] ([ID], [GUID]) VALUES (3, N'guid3')
INSERT [dbo].[test_users] ([ID], [GUID]) VALUES (4, N'guid4')
SET IDENTITY_INSERT [dbo].[test_users] OFF
GO
4 rows affected
SELECT * FROM [dbo].[test_users]
GO
ID | GUID
-: | :----
1 | guid1
2 | guid2
3 | guid3
4 | guid4
SET IDENTITY_INSERT [dbo].[articles] ON
INSERT [dbo].[articles] ([ID], [name]) VALUES (1, N'article1')
INSERT [dbo].[articles] ([ID], [name]) VALUES (2, N'article2')
INSERT [dbo].[articles] ([ID], [name]) VALUES (3, N'article3')
SET IDENTITY_INSERT [dbo].[articles] OFF
GO
3 rows affected
SELECT * FROM [dbo].[articles]
GO
ID | name
-: | :-------
1 | article1
2 | article2
3 | article3
SET IDENTITY_INSERT [dbo].[relational] ON
INSERT [dbo].[relational] ([ID], [articleid], [userguid]) VALUES (1, 1, N'guid1')
INSERT [dbo].[relational] ([ID], [articleid], [userguid]) VALUES (2, 1, N'guid2')
INSERT [dbo].[relational] ([ID], [articleid], [userguid]) VALUES (3, 2, N'guid2')
INSERT [dbo].[relational] ([ID], [articleid], [userguid]) VALUES (4, 1, N'guid3')
INSERT [dbo].[relational] ([ID], [articleid], [userguid]) VALUES (5, 3, N'guid3')
SET IDENTITY_INSERT [dbo].[relational] OFF
GO
5 rows affected
SELECT * FROM [dbo].[relational]
GO
ID | articleid | userguid
-: | --------: | :-------
1 | 1 | guid1
2 | 1 | guid2
3 | 2 | guid2
4 | 1 | guid3
5 | 3 | guid3
SET IDENTITY_INSERT [dbo].[seperated] ON
INSERT [dbo].[seperated] ([ID], [userguid], [articles]) VALUES (1, N'guid1', N'1')
INSERT [dbo].[seperated] ([ID], [userguid], [articles]) VALUES (3, N'guid2', N'1,2')
INSERT [dbo].[seperated] ([ID], [userguid], [articles]) VALUES (4, N'guid3', N'1,3')
INSERT [dbo].[seperated] ([ID], [userguid], [articles]) VALUES (5, N'guid4', N'')
SET IDENTITY_INSERT [dbo].[seperated] OFF
GO
4 rows affected
SELECT * FROM [dbo].[seperated]
GO
ID | userguid | articles
-: | :------- | :-------
1 | guid1 | 1
3 | guid2 | 1,2
4 | guid3 | 1,3
5 | guid4 |
db<>fiddle here
On the article table there are triggers for insert, delete and update.
After an insert, records are created in the relational table (only for the new article)
After an delete, records are removed in the relational table (only for the delete article)
After an update, records are created/removed (only for the updated article)
Afterwards the seperated table needs to be updated.
For each user there must be exactly 1 record, with comma seperated articles (basically user.guid, SELECT * FROM relational WHERE userguid = user.guid)
At the moment the seperated table gets completely updated using XML FOR PATH, after each insert/delete/update.
However this is no longer a viable option, since this operation is not fast enough (~5 - 10 million records in the relational table)
To fix this, I would like to update the seperated table only for the new/updated/deleted article:
Inside the trigger I have declared the articleid with #articleId.
On insert: add ',articleId' or add '#articleId' if the row is empty (cannot be null)
On delete: remove the articleId from all rows
On update: remove when needed and add when needed (depends on what is found in the relational table)
As I basically never work with comma seperated stuff, I have no idea how to do this.
Any help would be greatly appreciated :)
Notes:
No I cannot do this inside the application as the application that creates the article records cannot connect to the database (it uses some obscure API), and it is also not possible due to the network.
The amount of inserts, updates and deletes is quite low (thus we can get away with doing this in the trigger)
I HAVE to use a comma seperated structure, I cannot change the model, as the application that runs on top of this database is a 3rd party application, which we cannot change and neither cannot ask to be modified...
Yes, these tables are minified, not all columns are here as they do not matter for this question
Good day,
At the moment the seperated table gets completely updated using XML FOR PATH, after each insert/delete/update.
This make no sense in first glance...
if you edit users x,y,z then you should only update these rows in the [seperated] table. I see no explanation why you update all rows.
SQL Server is a tabular database and even so it supports unstructured data like XML and JSON, it usually do not perform best when we need to parse the values.
You have all the data that you need for the [seperated] table in the [relational] table. So there is no sense in parsing each value.
What do you care what is the current value? if you change the the value (add or remove ID) then simply update the value (string) in the [seperated] table using the information from the [relational] table filter by the userguid which were changed (using the inserted/deleted logical table).
1+2 can be done using "UPDATE FROM SELECT". You can get the list of the IDs using simple query with STRING_AGG function. Do not parse the content, but simply update (replace if you want) and SET the value of the column [articles] for all the rows that were changed (and only these who changed) which where inserted/deleted
On insert: add ',articleId' or add '#articleId' if the row is empty (cannot be null)
On delete: remove the articleId from all rows
On update: remove when needed and add when needed (depends on what is found in the relational table)
Same issue. Do not parse the values for each case. Adding IDs is simple but removing can be more complex. There is no reason to "add" or "remove" anything from the string. Simply update the value of the string to a new value which include all the relevant IDs each time.
Note! If you will provide your code instead of stories then we can provide a working example. You should provide all the queries to reproduce the entire scenario including the triggers and your old and new solutions/attempts
Approach 1 (simple solution, best for remove IDs and in some cases for all tasks): UPDATE the rows in [seperated], which were changed in [relational] using the [inserted] and [deleted] tables
In general the query should be something like bellow (remember that this is done AFTER the [relational] table was updated - I read the data from that table and re-create the value of the rows that were changed)
-------------------------------------------------- Replace
--> assuming that each user has a row in [seperated] even if no id (as described)
;With NyCTE as (
SELECT [userguid], SA = STRING_AGG([articleid], ',')
WITHIN GROUP (ORDER BY [articleid] ASC)
FROM dbo.[relational]
where userguid in (select userguid from inserted)
GROUP BY [userguid]
)
UPDATE [seperated] SET articles = NyCTE.SA
FROM[seperated]
INNER JOIN NyCTE ON NyCTE.userguid = [seperated].userguid
GO
--------------------------------------------------
Approach 2 (Fits only for adding IDs and in most cases it is best approach since we do need to aggregate the [relational] table but only the inserted table): ADDing Ids to existing values of the rows in [seperated], which were changed in [relational] using the [inserted] and [deleted] tables
If you want to use the approach of adding IDs to existing string (remember that SQL Server do not add or edit the string but replace it anyway when we use UPDATE.
---------------------------------------------------- Add
;With NyCTE as (
SELECT [userguid], SA = STRING_AGG([articleid], ',')
WITHIN GROUP (ORDER BY [articleid] ASC)
FROM dbo.inserted
where userguid in (select userguid from inserted)
GROUP BY [userguid]
)
UPDATE [seperated] SET articles = REPLACE(REPLACE('#' + CONCAT (articles,',', SA), '#,', ''), '#', '')
FROM[seperated]
INNER JOIN NyCTE ON NyCTE.userguid = [seperated].userguid
GO
--------------------------------------------------
---------- More Information --------------
Missing information and clarification
On the article table there are triggers for insert, delete and update.
Please provide the full code to reproduce the issue (missing the code for the triggers). Always prefer to use code over stories in technical forums.
At the moment the seperated table gets completely updated using XML FOR PATH
Where is the code?!?
Again, you give stories instead of code.
Inside the trigger I have declared the articleid with #articleId...
AGAIN! You provide stories instead of sample code. Show us what you do. Provide the code which you tested :-(
It sound like you planing to work with loop which is probably really bad idea, or even worse you plan a solution only to solve one row change. What oi you get 100k rows to insert?!?
The trigger should probably work with the "INSERTED" logical table and use simple JOIN, EXCEPT, or INTERSECT for the task. You should plan the trigger to work on SET of data and not single row.
On insert: add ',articleId' or add '#articleId' if the row is empty (cannot be null). On delete: remove the articleId from all rows. On update: remove when needed and add when needed (depends on what is found in the relational table)
SQL Server do not "ADD" string to a value in the table. It can only UPDATE the entire value. It can parse the value in advance and then it uses UPDATE and replace the value in the table. As mentioned SQL Server designed for best performance on relational model and not for parsing simple string in a loop.
Note! You should confirm that this is really a new id each time if you want to be safe. If you do this then you got more complex task.
I have this reasonably sized stored procedure that accepts 3 collections two UDTT collection and one CSV collection.
I have passed the following values to test stored procedure. However the problems occurred in one small master table called EmpDesignations with 5 columns. There is a loop I used in the store procedure to insert values to EmpDesignations. The loop is required because the values are extracted from the CSV string. As expected it does iterate 2 times with two sets of values. The first iteration the data was inserted successfully but in the second iteration data was not inserted. I have checked weather the data is empty but those variables #tmpEmpID and #tmp contain data. So cannot figure out the problem
The EmpDesignations table definition is
EmpID PK, FK not null
DesigID PK, FK not null
IsValid int not null
UpdtDT datetime not null containts to getDate()
AuthID int not null EmpID
here is the snapshot of the table columns and types
In the first iteration the passing values to the insert statement is shown in the watch window
As you can see, ##rowcount is 1 so worked in the first round!
In the following watch shows the passing values to the insert statement, this is in the second iteration:
But the ##rowcount is not 1 therefore the control rollbacks all insertions
Here is a video link of the debugging of the insert statement
here is the video of THE SECOND INSERT statement debugging
Table definition is correct, the number of values passed matches the number of input columns, and the variables are filled with values in both iterations, so what could be the problem???
here is the script that was generated by SQL server for the table EmpDesignations
USE [SMSV100]
GO
/****** Object: Table [dbo].[EmpDesignations] Script Date: 04/12/2014 08:50:23 ******/
SET ANSI_NULLS ON
GO
SET QUOTED_IDENTIFIER ON
GO
CREATE TABLE [dbo].[EmpDesignations](
[EmpID] [int] NOT NULL,
[DesigID] [int] NOT NULL,
[IsValid] [int] NOT NULL,
[UpdtDT] [datetime] NOT NULL,
[AuthID] [int] NOT NULL,
CONSTRAINT [PK_EmpDesignations] PRIMARY KEY CLUSTERED
(
[EmpID] ASC,
[DesigID] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
) ON [PRIMARY]
GO
ALTER TABLE [dbo].[EmpDesignations] WITH CHECK ADD CONSTRAINT [FK_EmpDesignations_Designations] FOREIGN KEY([DesigID])
REFERENCES [dbo].[Designations] ([DesigID])
GO
ALTER TABLE [dbo].[EmpDesignations] CHECK CONSTRAINT [FK_EmpDesignations_Designations]
GO
ALTER TABLE [dbo].[EmpDesignations] WITH CHECK ADD CONSTRAINT [FK_EmpDesignations_Employees] FOREIGN KEY([EmpID])
REFERENCES [dbo].[Employees] ([EmpID])
GO
ALTER TABLE [dbo].[EmpDesignations] CHECK CONSTRAINT [FK_EmpDesignations_Employees]
GO
ALTER TABLE [dbo].[EmpDesignations] ADD CONSTRAINT [DF_EmpDesignations_UpdtDT] DEFAULT (getdate()) FOR [UpdtDT]
GO
thanks
I am seeing a very strange issue with a SQL Insert statement, I have a simple table, with an ID and 2 datetimes, see create script below -
CREATE TABLE [dbo].[DATA_POPULATION_LOGS](
[ID] [int] IDENTITY(1,1) NOT FOR REPLICATION NOT NULL,
[START] [datetime] NOT NULL,
[FINISH] [datetime] NOT NULL,
CONSTRAINT [PK__DATA_POP__3214EC2705D8E0BE] PRIMARY KEY CLUSTERED
(
[ID] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
) ON [PRIMARY]
I am now trying to run the following insert script -
INSERT INTO [dbo].[DATA_POPULATION_LOGS]
([START]
,[FINISH])
VALUES
(GETDATE()
,GETDATE())
It is failing with the following error -
Msg 2627, Level 14, State 1, Line 1
Violation of PRIMARY KEY constraint 'PK__DATA_POP__3214EC2705D8E0BE'. Cannot insert duplicate key in object 'dbo.DATA_POPULATION_LOGS'. The duplicate key value is (11).
The duplicate key value in the error message above increases every time the insert is executed, so it seems to know it is an identity column.
What would be causing this issue?!
Thanks in advance.
Simon
EDIT
I have now created a copy of this table and can insert into the new table fine using that script, what could be causing it to fail?
Probably someone issued DBCC CHECKIDENT against the table. When you do this, SQL Server will obey you, and try to generate values starting from the RESEED and incrementing by the increment. It doesn't check first to see if those values already exist (even if there is a PK). Simple repro that generates the same error:
USE tempdb;
GO
CREATE TABLE dbo.floob(ID INT IDENTITY(1,1) PRIMARY KEY);
GO
INSERT dbo.floob DEFAULT VALUES;
GO
DBCC CHECKIDENT('dbo.floob', RESEED, 0);
GO
INSERT dbo.floob DEFAULT VALUES;
GO
DROP TABLE dbo.floob;
To stop this from happening, you could figure out what the max value is now, and then run CHECKIDENT again:
DBCC CHECKIDENT('dbo.tablename', RESEED, <max value + 10 or 20 or something here>);
i have this sql table
CREATE TABLE Notes(
NoteID [int] IDENTITY(1,1) NOT NULL,
NoteTitle [nvarchar](255) NULL,
NoteDescription [nvarchar](4000) NULL
) CONSTRAINT [PK_Notes] PRIMARY KEY CLUSTERED
(
NoteID ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF,
ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
) ON [PRIMARY]
And i want to copy records from a temporary table INCLUDING the NoteID(using sql query)..
this is my script:
SET IDENTITY_INSERT Notes OFF
INSERT INTO Notes (NoteID, NoteTitle,NoteDescription)
SELECT NoteID, NoteTitle,NoteDescription from Notes_Temp
SET IDENTITY_INSERT Notes ON
with this script, i'm getting an error:
Cannot insert explicit value for identity column in table 'Notes' when IDENTITY_INSERT is set to OFF.
is there other way of insert records to a table with identity column using sql query?
Change the OFF and ON around
SET IDENTITY_INSERT Notes ON
INSERT INTO Notes (NoteID, NoteTitle,NoteDescription)
SELECT NoteID, NoteTitle,NoteDescription from Notes_Temp
SET IDENTITY_INSERT Notes OFF
SET IDENTITY_INSERT Notes ON
INSERT INTO Notes
/*Note the column list is REQUIRED here, not optional*/
(NoteID, NoteTitle,NoteDescription)
SELECT NoteID, NoteTitle,NoteDescription from Notes_Temp
SET IDENTITY_INSERT Notes OFF
You're inserting values for NoteId that is an identity column.
You can turn on identity insert on the table like this so that you can specify your own identity values.
Presumably you are using SQL Server (you don't say) and have misunderstood the meaning and purpose of IDENTITY_INSERT. In general, you are not allowed to explicitly set the value of an IDENTITY column, but by setting IDENTITY_INSERT to ON for a table you can temporarily permit such inserts.