# Program to rip entire websites?

**URL:** <https://forums.speedlife.net/t/program-to-rip-entire-websites/59686>\
**Category:** NYSpeed Off Topic\
**Created:** [December 13, 2008, 4:29pm UTC](https://forums.speedlife.net/t/program-to-rip-entire-websites/59686 "2008-12-13T16:29:34Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![sureshot](https://yyz2.discourse-cdn.com/flex034/user_avatar/forums.speedlife.net/sureshot/32/7578_2.png) [@sureshot](https://forums.speedlife.net/u/sureshot)\
**Post date:** [December 13, 2008, 4:29pm UTC](https://forums.speedlife.net/t/program-to-rip-entire-websites/59686/1 "2008-12-13T16:29:34Z")

</div>

Hey guys. I’m looking for a program that once you load in the web address, it will download everything from the different pages, to the content, to shared/linked/hosted videos, everything.

Specifically I’d like one that could do this to a forum. For example, if I was a raving lunatic and actually wanted a version of NYSpeed saved to my computer, every thread, every hosted picture, etc. could I accomplish this?

I googled and found some amateur programs that seemed more shady than helpful.

Hopefully someone can point me in the right direction.

Thanks!

-Adam

---

<div class="post-metadata">

**Author:** ![JustinH](https://avatars.discourse-cdn.com/v4/letter/j/9fc29f/32.png) [@JustinH](https://forums.speedlife.net/u/JustinH)\
**Post date:** [December 13, 2008, 4:38pm UTC](https://forums.speedlife.net/t/program-to-rip-entire-websites/59686/2 "2008-12-13T16:38:24Z")

</div>

It would be simple with a static html page. Most websites run software that generates content based on what the user wants, so scraping that would be pretty complex to say the least.

When I sold car parts, our supplier wouldn’t give us direct access to their live database. I had to hire a coder to write a program that would go to their public website, and scrape their inventory, and update my website in real time.

---

<div class="post-metadata">

**Author:** ![sureshot](https://yyz2.discourse-cdn.com/flex034/user_avatar/forums.speedlife.net/sureshot/32/7578_2.png) [@sureshot](https://forums.speedlife.net/u/sureshot)\
**Post date:** [December 13, 2008, 4:42pm UTC](https://forums.speedlife.net/t/program-to-rip-entire-websites/59686/3 "2008-12-13T16:42:02Z")

</div>

Thanks for the reply. I actually have a bunch of static pages ( that just require a login ) That all host a bunch of movie clips, ranging in 50meg to 100meg in size. I’d like to just rip them all down :lol:

I’ll just manually go through the forum and save the threads I want

---

<div class="post-metadata">

**Author:** ![JustinH](https://avatars.discourse-cdn.com/v4/letter/j/9fc29f/32.png) [@JustinH](https://forums.speedlife.net/u/JustinH)\
**Post date:** [December 13, 2008, 4:43pm UTC](https://forums.speedlife.net/t/program-to-rip-entire-websites/59686/4 "2008-12-13T16:43:44Z")

</div>

OH… you want to rip a porno site…

Just use the downthemall! plugin for firefox.

The download accelerator is amazing, and the ripper works very well…

---

<div class="post-metadata">

**Author:** ![neonglh](https://yyz2.discourse-cdn.com/flex034/user_avatar/forums.speedlife.net/neonglh/32/4951_2.png) [@neonglh](https://forums.speedlife.net/u/neonglh)\
**Post date:** [December 13, 2008, 4:47pm UTC](https://forums.speedlife.net/t/program-to-rip-entire-websites/59686/5 "2008-12-13T16:47:57Z")

</div>

Can’t you do this with IE, and save for offline use? You can then select the number of pages deep you want it to save. It used to be a feature, not sure if they still have it in 6 and 7.

---

<div class="post-metadata">

**Author:** ![sureshot](https://yyz2.discourse-cdn.com/flex034/user_avatar/forums.speedlife.net/sureshot/32/7578_2.png) [@sureshot](https://forums.speedlife.net/u/sureshot)\
**Post date:** [December 13, 2008, 4:48pm UTC](https://forums.speedlife.net/t/program-to-rip-entire-websites/59686/6 "2008-12-13T16:48:30Z")

</div>

:lol: I honestly don’t want to rip a porno site. However, I wouldn’t be ashamed if I did.

Thanks for the headsup on the addon, I honestly did not want to sit at my computer and start new downloads every 5 minutes. :tup:

A shame about the forum raper though ☹

---

<div class="post-metadata">

**Author:** ![Matt\_Danger](https://yyz2.discourse-cdn.com/flex034/user_avatar/forums.speedlife.net/matt_danger/32/4981_2.png) [@Matt\_Danger](https://forums.speedlife.net/u/Matt_Danger)\
**Post date:** [December 13, 2008, 4:56pm UTC](https://forums.speedlife.net/t/program-to-rip-entire-websites/59686/7 "2008-12-13T16:56:09Z")

</div>

wget

Edit: I forget not everyone lives in a shell, ha. [http://www.httrack.com/](http://www.httrack.com/)

---

<div class="post-metadata">

**Author:** ![97FormulaWS-6](https://yyz2.discourse-cdn.com/flex034/user_avatar/forums.speedlife.net/97formulaws-6/32/7384_2.png) [@97FormulaWS-6](https://forums.speedlife.net/u/97FormulaWS-6)\
**Post date:** [December 13, 2008, 6:31pm UTC](https://forums.speedlife.net/t/program-to-rip-entire-websites/59686/8 "2008-12-13T18:31:59Z")

</div>

In Firefox I use the ScrapBook add-in and it works well. Not sure how it would work on forums though. Works great on DIY, How-To’s, and other websites though.

---

<div class="post-metadata">

**Author:** ![LZ1](https://avatars.discourse-cdn.com/v4/letter/l/7ab992/32.png) [@LZ1](https://forums.speedlife.net/u/LZ1)\
**Post date:** [December 14, 2008, 6:03am UTC](https://forums.speedlife.net/t/program-to-rip-entire-websites/59686/9 "2008-12-14T06:03:56Z")

</div>

> [@Matt Danger](#):
>
> wget
> 
> Edit: I forget not everyone lives in a shell, ha. [http://www.httrack.com/](http://www.httrack.com/)

:word:
