postsql trouble when populating a table with comma separator - sql

Question

I am trying to populate a table, and I have values with "," from my array "name". so This is not working, if I use something other than a comma separator, it says
BadCopyFileFormat: missing data for column
s = "CREATE TABLE IF NOT EXISTS tokens (address varchar(100) NOT NULL,symbol varchar(100) NOT NULL,name varchar(100) NOT NULL)"
db_cursor.execute(s)
with open('data/tokens.csv', 'r', encoding="utf-8") as f:
next(f) # Skip the header row.
db_cursor.copy_from(f, 'tokens', sep=',')
db_conn.commit()
My data look like
address symbol name
x23fva3 ABC ABC
2vajd83 DAP
29vb4h2 Wink Jamal, ab
2jsbg93 x3 xon3
Is there a way to populate the table with missing values??

Answer 1

What I got to work:
cat data/tokens.csv
address |symbol|name
x23fva3 | ABC | ABC
2vajd83 | DAP |
29vb4h2 | Wink | Jamal, ab
2jsbg93 | x3 | xon3
with open('data/tokens.csv', 'r', encoding="utf-8") as f:
next(f) # Skip the header row.
db_cursor.copy_from(f, 'tokens', sep='|')
db_conn.commit()
select * from tokens ;
address | symbol | name
----------+--------+------------
x23fva3 | ABC | ABC
2vajd83 | DAP |
29vb4h2 | Wink | Jamal, ab
2jsbg93 | x3 | xon3
I use the pipe(|) regularly for this sort of thing as it very rarely shows up in data on its own.
UPDATE
For a file with empty values there needs to still be a separator for each field like:
address |symbol|name
x23fva3 | ABC | ABC
2vajd83 | DAP |
32vb4h3 | |
1jsbg94 | | xon3