Write Pandas Dataframe to CSV with a variable name in pathway - pandas

Question

I've written a python script that takes in a file and matches some columns in another file. I would like to write this to a csv with the name "[original file name]_matched". E.g. I have a bunch of files (xaa, xab, ...) and after running the script on each file I would also have (xaa_matched, xab_matched, etc...) This is what I've tried based on this solution: Set File_Path for to_csv() in Pandas
import sys
import os
filename = sys.argv[1]
# some code
path = r'/Users/mdong/dataScience/movie_representation/fuzzy_match_dir/'
input_file.to_csv(os.path.join(path,'match_' + filename), index = False)
However, I get back this error
Traceback (most recent call last):
File "movie_matching.py", line 29, in <module>
input_file.to_csv(os.path.join(path,filename), index = False)
File "/Users/mdong/anaconda/lib/python3.6/site-packages/pandas/core/frame.py", line 1413, in to_csv
formatter.save()
File "/Users/mdong/anaconda/lib/python3.6/site-packages/pandas/io/formats/format.py", line 1568, in save
compression=self.compression)
File "/Users/mdong/anaconda/lib/python3.6/site-packages/pandas/io/common.py", line 382, in _get_handle
f = open(path_or_buf, mode, errors='replace')
FileNotFoundError: [Errno 2] No such file or directory: '/Users/mdong/dataScience/movie_representation/fuzzy_match_dir/fuzzy_match_dir/xaa.csv'
I'm not sure what's going wrong in order to troubleshoot, any pointers would be appreciated!

Answer 1

I would use pathlib in this situation.
from pathlib import Path
p = Path('/Path/to/your/folder/')
input_file.to_csv(Path(p, 'match_' + filename + '.csv')), index=False)
I would also check that your filename variable is what you expect it to be. Which you can do with Pathlib as well.
>>> p = Path('/Path/To/Thing.csv')
>>> p.stem
'Thing'
>>> p.name
'Thing.csv'