This should remove duplicate lines on Linux and also sort the results in by chronological way.
sort -n -t, -k1,1n NZDUSD_1m.csv | uniq -w 16 > sNZDUSD_1m.csv
This should remove duplicate lines on Linux and also sort the results in by chronological way.
sort -n -t, -k1,1n NZDUSD_1m.csv | uniq -w 16 > sNZDUSD_1m.csv