I have a web crawler script written in Perl.
It outputs URL, keywords, description, title to a single text file ([login to view URL]), each separated by tab per line.
I would like to make the script be made so it outputs the results to sets of 50K records, like [login to view URL] [login to view URL] [login to view URL] and so on. It should be a pretty easy project to complete.