command working for small data but not for big data - awk

Question

I'm trying to select the list of ID's where specific position is not empty (for ex; position 29,30,103 and 104). If the position is empty it should be rejected, tried with awk its working well with less data (<100) but all the ID's are getting selected with big data (>1000000).
Please provide suggestion.
awk '
{FS=",";$0=$0;
if ($29!="" && $30!="" && $323!="" && $324!= "") print "ID", NR, "selected" }
' file.csv
this cmd works only with small data, please advice where i'm missing out.

Answer 1

I've generated a file with 1024456 records. Each record has 152 fields separated by commas and each record is generated with a probability of getting empty fields across the records fields.
Sample of the data:
,,29378,,,,10154,,,,,,,,6118,,29,15384,,,,27106,30693,,,,2021,,,,,30609,,15148,,,3406,10181,,,,178,,,,,,,,31308,10049,,,14783,,,,,26032,,,,21999,,,15978,,,,,,12975,22933,,,18981,,,,,,21590,21196,,,,,,14680,,18167,9839,,,5282,,,27112,,,1264,,,22086,,,,,,,,,,,,,,18940,,,11353,,,29966,32569,2495,,11841,,25529,,15423,,,,2799,,15511,,,3010,,,4359,,,,,,12244,18968,13926
As expected, explicitly avoiding retokenizing every record will yield better results:
for run in {1..10}; do \
/usr/bin/time --format='%C took %e seconds' \
awk -F"," \
'{if ($29!="" || $30!="" || $92!="" || $132!= "") print "ID", NR, "selected" }' \
file1.txt > /dev/null;
done
awk (...) took 3.36 seconds
awk (...) took 3.35 seconds
awk (...) took 3.78 seconds
awk (...) took 3.48 seconds
awk (...) took 3.58 seconds
awk (...) took 3.75 seconds
awk (...) took 3.49 seconds
awk (...) took 3.53 seconds
awk (...) took 3.47 seconds
awk (...) took 3.93 seconds
Than the original solution the OP provided:
for run in {1..10}; do \
/usr/bin/time --format='%C took %e seconds' \
awk \
'{FS=",";$0=$0; if ($29!="" || $30!="" || $92!="" || $132!= "") print "ID", NR, "selected" }' \
file1.txt > /dev/null;
done
awk (...) took 9.04 seconds
awk (...) took 8.93 seconds
awk (...) took 9.05 seconds
awk (...) took 9.14 seconds
awk (...) took 8.93 seconds
awk (...) took 9.05 seconds
awk (...) took 8.76 seconds
awk (...) took 9.72 seconds
awk (...) took 9.29 seconds
awk (...) took 9.17 seconds
PS: I've run each solution 10 times to average out the results and I also made a slight change to the OP code as per the requirement (only one of the fields must be empty for the record to be selected).