huge-merge.pl - Merge the results of multiple huge-sort generated files into a single sorted file.
count.pl --tokenlist input1.out input1 count.pl --tokenlist input2.out input2
huge-sort.pl input1.out huge-sort.pl input2.out
mv input1.out-sorted output-directory mv input2.out-sorted output-directory
huge-merge.pl output-directory
Combine the sorted bigram files generated by huge-sort.pl efficiently.
This program is used internally by huge-count.pl.
huge-merge.pl [OPTIONS] SOURCEDIR
Input to huge-merge.pl should be a single flat directory containing multiple plain text files generated by huge-sort.pl. The result file, merge.* (* is a number, the final result file has the maximum number), is in the source directory.
Switches ON the --keep option will keep all the intermediate merging files.
Displays the help information.
Displays the version information.
Ying Liu, University of Minnesota, Twin Cities. liux0395 at umn.edu
Ted Pedersen, University of Minnesota, Duluth. tpederse at umn.edu
Copyright (C) 2009-2010, Ying Liu and Ted Pedersen
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, USA.
To install Text::NSP, copy and paste the appropriate command in to your terminal.
cpanm
cpanm Text::NSP
CPAN shell
perl -MCPAN -e shell install Text::NSP
For more information on module installation, please visit the detailed CPAN module installation guide.