# Large File Compare Software

**URL:** <https://forums.speedlife.net/t/large-file-compare-software/72344>\
**Category:** NYSpeed Off Topic\
**Created:** [August 19, 2009, 7:04pm UTC](https://forums.speedlife.net/t/large-file-compare-software/72344 "2009-08-19T19:04:24Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![Jack](https://yyz2.discourse-cdn.com/flex034/user_avatar/forums.speedlife.net/jack/32/7613_2.png) [@Jack](https://forums.speedlife.net/u/Jack)\
**Post date:** [August 19, 2009, 7:04pm UTC](https://forums.speedlife.net/t/large-file-compare-software/72344/1 "2009-08-19T19:04:24Z")

</div>

It seems like I’ve tried everything.

UltraCompare (UltraEdit’s compare software) dies 50% of the way through.

I’ve also tried -  
UltraEdit - Doesn’t do anything. Just sits there looking at me.  
Compare IT! - File in Use! - I think it just can’t handle it.  
WinMerge - Out Of Memory - Not quite… I’m not even breaking 50% usage.  
And a bunch of others that I’ve downloaded, tried, and uninstalled.

What software are you guys using to do a line by line compare with large text files?

The 2 I’m trying to get done tonight are over 800mb each, but I may have larger files in the future. There are over 16M rows and they are about 1200ch wide.

---

<div class="post-metadata">

**Author:** ![LZ1](https://avatars.discourse-cdn.com/v4/letter/l/7ab992/32.png) [@LZ1](https://forums.speedlife.net/u/LZ1)\
**Post date:** [August 20, 2009, 3:37am UTC](https://forums.speedlife.net/t/large-file-compare-software/72344/2 "2009-08-20T03:37:23Z")

</div>

You need more ram…

or use diff from the command line on a linux box…

---

<div class="post-metadata">

**Author:** ![boardjnky4](https://avatars.discourse-cdn.com/v4/letter/b/96bed5/32.png) [@boardjnky4](https://forums.speedlife.net/u/boardjnky4)\
**Post date:** [August 20, 2009, 4:46am UTC](https://forums.speedlife.net/t/large-file-compare-software/72344/3 "2009-08-20T04:46:32Z")

</div>

diff ftw

---

<div class="post-metadata">

**Author:** ![walter](https://yyz2.discourse-cdn.com/flex034/user_avatar/forums.speedlife.net/walter/32/7202_2.png) [@walter](https://forums.speedlife.net/u/walter)\
**Post date:** [August 20, 2009, 9:39am UTC](https://forums.speedlife.net/t/large-file-compare-software/72344/4 "2009-08-20T09:39:59Z")

</div>

You need a better video card, let the GPU do all the processing.

---

<div class="post-metadata">

**Author:** ![boardjnky4](https://avatars.discourse-cdn.com/v4/letter/b/96bed5/32.png) [@boardjnky4](https://forums.speedlife.net/u/boardjnky4)\
**Post date:** [August 20, 2009, 9:50am UTC](https://forums.speedlife.net/t/large-file-compare-software/72344/5 "2009-08-20T09:50:16Z")

</div>

I lol’d

---

<div class="post-metadata">

**Author:** ![ILC](https://yyz2.discourse-cdn.com/flex034/user_avatar/forums.speedlife.net/ilc/32/5337_2.png) [@ILC](https://forums.speedlife.net/u/ILC)\
**Post date:** [August 20, 2009, 10:06am UTC](https://forums.speedlife.net/t/large-file-compare-software/72344/6 "2009-08-20T10:06:51Z")

</div>

whats wrong with md5 hashing?

---

<div class="post-metadata">

**Author:** ![LZ1](https://avatars.discourse-cdn.com/v4/letter/l/7ab992/32.png) [@LZ1](https://forums.speedlife.net/u/LZ1)\
**Post date:** [August 20, 2009, 10:18am UTC](https://forums.speedlife.net/t/large-file-compare-software/72344/7 "2009-08-20T10:18:46Z")

</div>

> [@ILC](#):
>
> whats wrong with md5 hashing?

:lol: i md5 hashed the two files and clearly there is a difference.

---

<div class="post-metadata">

**Author:** ![boardjnky4](https://avatars.discourse-cdn.com/v4/letter/b/96bed5/32.png) [@boardjnky4](https://forums.speedlife.net/u/boardjnky4)\
**Post date:** [August 20, 2009, 10:23am UTC](https://forums.speedlife.net/t/large-file-compare-software/72344/8 "2009-08-20T10:23:03Z")

</div>

yeah, that wont tell you where the diff is

---

<div class="post-metadata">

**Author:** ![Jack](https://yyz2.discourse-cdn.com/flex034/user_avatar/forums.speedlife.net/jack/32/7613_2.png) [@Jack](https://forums.speedlife.net/u/Jack)\
**Post date:** [August 20, 2009, 3:22pm UTC](https://forums.speedlife.net/t/large-file-compare-software/72344/9 "2009-08-20T15:22:19Z")

</div>

> [@LZ](#):
>
> You need more ram…
> 
> or use diff from the command line on a linux box…

Its not even utilizing 3gb of the 6gb available.

If my understanding of diff is right, it will read a new line as an “error”, and every line after it will also be an “error”.

I’ve been splitting the files at a common point and running it 200mb at a time… until I find a decent solution.

---

<div class="post-metadata">

**Author:** ![boxxa](https://yyz2.discourse-cdn.com/flex034/user_avatar/forums.speedlife.net/boxxa/32/5045_2.png) [@boxxa](https://forums.speedlife.net/u/boxxa)\
**Post date:** [August 21, 2009, 6:34am UTC](https://forums.speedlife.net/t/large-file-compare-software/72344/10 "2009-08-21T06:34:12Z")

</div>

> [@Jack](#):
>
> Its not even utilizing 3gb of the 6gb available.
> 
> If my understanding of diff is right, it will read a new line as an “error”, and every line after it will also be an “error”.
> 
> I’ve been splitting the files at a common point and running it 200mb at a time… until I find a decent solution.

Shut up.

---

<div class="post-metadata">

**Author:** ![Jack](https://yyz2.discourse-cdn.com/flex034/user_avatar/forums.speedlife.net/jack/32/7613_2.png) [@Jack](https://forums.speedlife.net/u/Jack)\
**Post date:** [August 21, 2009, 5:14pm UTC](https://forums.speedlife.net/t/large-file-compare-software/72344/11 "2009-08-21T17:14:28Z")

</div>

> [@boxxa](#):
>
> Shut up.

Elaborate.
