Large File Compare Software

NYSpeed Automotive NYSpeed Off Topic
1

It seems like I’ve tried everything.

UltraCompare (UltraEdit’s compare software) dies 50% of the way through.

I’ve also tried -
UltraEdit - Doesn’t do anything. Just sits there looking at me.
Compare IT! - File in Use! - I think it just can’t handle it.
WinMerge - Out Of Memory - Not quite… I’m not even breaking 50% usage.
And a bunch of others that I’ve downloaded, tried, and uninstalled.

What software are you guys using to do a line by line compare with large text files?

The 2 I’m trying to get done tonight are over 800mb each, but I may have larger files in the future. There are over 16M rows and they are about 1200ch wide.

2

You need more ram…

or use diff from the command line on a linux box…

3

diff ftw

4

You need a better video card, let the GPU do all the processing.

5

I lol’d

6

whats wrong with md5 hashing?

7

:lol: i md5 hashed the two files and clearly there is a difference.

8

yeah, that wont tell you where the diff is

9

Its not even utilizing 3gb of the 6gb available.

If my understanding of diff is right, it will read a new line as an “error”, and every line after it will also be an “error”.

I’ve been splitting the files at a common point and running it 200mb at a time… until I find a decent solution.

10

Shut up.

11

Elaborate.