TideLog Archive for December, 2009

Please follow these common sense rules to avoid any network abuse when using WinHTTrack. It’s not fair for other users or the webmaster of the site if you’re hogging all his bandwidth. Not all sites have unlimited bandwidth.

I have taken this info from http://www.httrack.com/html/abuse.html. Check back there for any changes

  • Do not overload the websites!
    • Do not download too large websites: use filters, but use them sensibly
    • Do not use too many simultaneous connections
    • Use bandwidth limits
    • Use connection limits
    • Use size limits
    • Use time limits
    • Only disable robots.txt rules with great care
    • Try not to download during working hours
    • Check your mirror transfer rate/size
    • For large mirrors, first ask the webmaster of the site
  • Downloading a site can overload it, if you have a fast pipe, or if you capture too many simultaneous cgi (dynamically generated pages).

  • Ensure that you can copy the website
    • Are the pages copyrighted?
    • Can you copy them only for private purpose?
    • Do not make online mirrors unless you are authorized to do so
  • Do not overload your network
    • Is your (corporate, private..) network connected through dialup ISP?
    • Is your network bandwidth limited (and expensive)?
    • Are you slowing down the traffic?
  • Do not steal private information
    • Do not grab emails
    • Do not grab private information

Following these general guidelines will ensure fairness for all. I’ve seen sites shut down because the webmaster was fed up of his site keep running out of monthly bandwidth, costing him extra money in server and host costs.

Use my article advice, and Xavier’s brilliant software, with GREAT care, and be considerate of others. Make donations to your favourite sites!

Many thanks to Bandit for his pointers about a disclaimer.

Comments No Comments »

I’m going to show you all my perfect way of backing up your games. I’ve been doing it this way for ages, and have never had any failures.

LEGAL DISCLAIMER

Before we start, I must make you aware that MODIFYING YOUR CONSOLE FIRMWARE IS ILLEGAL, and that you have to modify it to play backups. The backups you create MUST be for PERSONAL USE ONLY, any other distribution or use is possibly illegal, and in breach of Copyright and DMCA laws in some countries.

Secondly, I CANNOT BE HELD RESPONSIBLE for any legal action taken against you from you distributing backups from following my guide, for any failures during flashing Kreon firmware or burning backups, or simply because you don’t understand what you’re doing.

All advice in this article is followed AT YOUR OWN RISK. If your console decides to burst into flames after being modified, that’s not my problem, sue the hackers who created the firmware! Or if you like fighting useless battles, sue Microsoft (they’ll probably laugh you into a prison cell!)

Disclaimer over….. If I haven’t scared you (scaring you wasn’t my intention!), read on……

Recommended Setup:

DVD Burner on its own IDE/SATA Channel

I recommend your burner be on its own chain. This reduces the risk of buffer underruns and any other errors. having a hard drive, especially the one where images are stored for burning, or being read from, on the same cable, is a no-no.

I use SATA, so each device has its own cable, and is not daisychained.

No other programs running

This keeps your CPU nice and free, and keeps your RAM to a maximum. Your RAM is where data is stored as it’s being copied from the HDD to the burner, so if you’re running stressful programs, your burner is going to feel it, and you run the risk of ruining the disc, and DL discs are still not cheap throwaways! The flow of data needs to be constant.

Use a dual core CPU

This gives you more oomph, as any load is shared equally between cores. Self explanatory, really!

Plenty of RAM

This is a must, as I mentioned before, your RAM is the buffer between the hard drive, and the burner. Top quality RAM will make sure the data stays clean all the way from your HDD to your burner. 32 bit users should have no more than 3GB, as 32-bit can’t address more than this, and 64-bit can have as much as you want!

Defragmented hard drive

Think of your hard drive as my favourite analogy. A child’s bedroom. As toys (files) get played with (accessed/saved), they get strewn all around. This maeans the drive takes longer to find files, which can result in buffer under-runs. The files need to be re-organised into their correct places for accesses to be fast.

The Tutorial

1. Obtain a Samsung SH-D162C PC drive with Kreon

This step is really important. Normal PC drives can’t read the structure or security sectors (SS) of a 360 disk. The Kreon firmware is modified so that this Samsung drive will. The Kreon firmware will not work for other drives. I recommend you get one pre-flashed, I did my own, but that’s out of the scope of this tutorial. There are IDE & SATA versions available now, I got mine on launch, and it was only IDE at the time, so take your pick.

Once you’ve installed the drive, and flashed it (if it wasn’t already), move on..

2. Download and install Xbox Backup Creator

This is by far the easiest tool out there for doing backups, and is almost a single click. Download it from HERE and extract it somewhere. You’ll need ImgBurn installed too, so go grab a copy and install it BEFORE running XBC.

NOTE: If you’ve got a blank DVD-DL in your burner drive, the following error may come up. Don’t worry about it, it’s only because it’s trying to read a blank disc:

If you take the blank disc out, the error doesn’t appear. So, insert the 360 game you want to copy into your Samsung Kreon drive, and run XBC:

Make sure your Samsung Kreon drive is selected in the top drive list, as my SH-D162 is here. Note it does not say what Kreon version firmware is installed, just TS05, which is the Samsung firmware that the Kreon is based on. I have the latest Kreon in my drive, which is v1.00.

In the main status window, it says “Bytes used: 5.32MB”. DON’T worry, the disc is being read correctly, this is just the DVD partition that displays the “To play this disc, please insert it into an Xbox 360 console”, as this is all the PC itself can see.

Next, on the Read tab, under Image Style, choose Complete Backup, then hit Start. Sometimes the Start button is greyed out, flick between the tabs, and it should appear:

CAUTION: If you miss this step, and the Current Partition is selected, you’ll end up with just the DVD partition, which is useless!!

When you click Start, a dialog will pop up asking you for an image filename, and where to save it. My test game was Flatout Ultimate Carnage, saved into an “xbox” folder on my desktop:

Choose your folder and name, then hit Save. It’ll then start copying the image. To prove my point about the DVD partition earlier, here’s what I deliberately did:

I deliberately saved to a partition with not enough space to get this to come up. It needs 7.4GB, so it is copying the FULL game. So, here’s it working correctly:

It will also create a .dvd file. You MUST use this when burning the game later with ImgBurn. It is the layerbreak file, and without it, the partitions won’t match, resulting in an unplayable coaster. DO NOT select the ISO!

Follow me, and you’ll be fine!!

Next, should be when all is done!

Step 3: Burn your game to disc using ImgBurn!

ImgBurn is a great program. It has flawlessly burned discs for me with no problems. As long as you select the .dvd layerbreak file when selecting the image, it will burn fine. Using the ISO directly will fail.

First off, insert your blank DVD-DL (Verbatim, always Verbatim, where possible. I have used AONE in this tutorial, as they are my second favourite). Start ImgBurn, to be greeted by this screen:

Click “Write image file to disc”, and go to the folder you created your image. I’m finishing off a burn of Forza 3 here, instead of my Flatout earlier:

Select the .dvd layerbreak file, this is REALLY IMPORTANT:

Click Open. Then make sure 4x is selected as a burn speed:

After verifying your burner is correct, click the big icon of an image to disc on the left of the burn speed, and away she goes!! Until it completes, you will then be presented (hopefully!) with this dialog:

All done! Insert into your Xbox, and play away!

Note: This tutorial covers YOUR OWN backups. Backups downloaded from the internet will need to be verified by abgx360. A tutorial on this is to follow soon…

Comments No Comments »

I’ve had a lot of people ask me how to correctly rip a website using WinHTTrack on its forum. It isn’t your fault you’re getting errors, it’s the programs default settings, they’re set incorrectly, causing the copier to get booted off almost straight away in some cases. I’m here to help, because the only “person” on there, William Roeder, is the most arrogant, nasty, clueless individual I and many other HTTrack users have met.

So, to get a good copy, we need to understand several things that may STOP a copy:

Problem 1 – Browser ID (User Agent) set incorrectly as default

Every web browser has a User Agent string. This tells a web server about the browser, and details the operating system it is running on. Mine looks like this:

Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.1.6) Gecko/20091201 Firefox/3.5.6 (.NET CLR 3.5.30729)

Here’s a table that shows what all that means:

This is where one of the problems HTTrack causes comes in. Many websites don’t allow website copiers, because they eat bandwidth, so they are blocked. The Robots.txt file is where specific useragents can be specified for blocking, and resides on the server. HTTrack’s default UserAgent is like this:

Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)

So, because it contains the HTTrack bit, the copier is getting kicked, without the website being copied. We can change this so that HTTrack can pretend to be another browser! I will show you how later in this article.

Problem 2 – Spider – follow Robots.txt enabled

WinHTTrack is a web spider. It works in many ways the same as a web browser. It scours a website, and copies everything you tell it to. By default, it is set to specifically follow the Robots.txt file as detailed above, and because of this, with all default settings and User Agent, gets kicked. I don’t know why Xavier Roche (the author) has never changed the defaults, because it is causing confusion. I’m here to help!

Step 1 – One thing it WON’T do:

1. Copy files from folders that have Directory Listing disabled.

This is not a bug, it’s deliberate. If the website owner doesn’t want you to view folder contents, a copier won’t see them either! This is set in a .htaccess file on the server, and CANNOT be overridden, unless web pages on the site link to what’s in the folder.

Step 2 – Setting Options

Once you’ve set your links in the Addresses window, click Set Options. If you’re copying a subscription site, don’t just paste URLS in the text box, use the Add URL button. This allows you to enter your credentials. Otherwise, copying will fail.

Then, click the Limits tab, and set Max Transfer to 50,000. If ripping a lot of high res pictures, zips, and videos, I enter 250,000 – 500,000 in, as this is in Bytes, and not Kilobytes:

Leave everything else on this tab as is, and click the Spider tab. Here we’ll stop HTTrack following the robots file:

Set Spider to “no robots.txt rules”, leave everything else, and go to the Browser ID tab. Here we’re going to “spoof” HTTrack as another browser to fool the webserver into thinking we’re just another internet surfer!

Set “Browser identity” to anything you like, as long as you don’t pick one that’s too old, as some sites don’t allow old or obsolete browsers, due to them not being supported and possibly full of holes. I set mine to “Mozilla/4.78 [en] (Windows NT 5.0; U)”, as that’s fairly close to mine. You can add your own browser if you know how, but that is out of the scope of this article.

Also, set the HTML Footer to “None”, this removes the “Mirrored by HTTrack” footer stamped on copied pages, for cleanness.

That’s it! Click OK, then Next, and your site should rip! If you have any problems, leave me a comment, and if I feel relevant, I’ll do an article on your problem for you, and how to put it right. I’ve been using HTTrack since its first release, and can take the time to explain things nicely, in a polite manner, unlike William Roeder. His second name should be “Ruder!!”

Comments 60 Comments »

I hurt my back last weekend, I slipped on some black ice, and my lower back took most of the impact. It was sore for about two days, then eased off a little, but then went bad again. I went to the doctor on Wednesday, and he’s told me not to do any heavy lifting (or football) for at least another month.

I wasn’t due to restart training with Rikku and her ladies until the second week in January, so I suppose knocking it back two weeks won’t make much difference. I told Rikky yesterday, and she agreed with the doctor, as she’s team first aider as well as captain. I could do more damage, especially in goalkeeping dives and tackles, if I land on my hips, it could shock my spine.

She just sweetly told me, “Just get yourself better, we’ve got plenty of time for your training”. She must have told the girls, because this morning a Get Well card signed by them all popped through my door!

Awwww, it was really touching. I bet a lads team wouldn’t have done that for me! So, women footballers are sweet as well as cute!! But we knew that already! 🙂 I just hope all the ice is gone by tomorrow, I’ve got a bit of walking to do… RAIN! PLEASE!!! Another slip, and my back could be kaput, and that isn’t a nice thought. All internal cabling to the big computer in your head runs up your spine… 🙁

Comments No Comments »

Today was better than I expected! It’s a good job we’ve got a big house here in Birmingham, we need the space for all the presents! God knows what it’s going to be like whe Kassie and I get married with all the wedding presents! I’ve just got a few minutes out from the partying! I’m possibly the only one not drinking (alchol, anyway) as I’ve got to drive loads of people home later on! There’s more of Kassie’s friends here, than mine, and more than I expected (women seem to have lots of friends as well as handbags and pairs of shoes!!)

Wow, where do I start? The godsend is that Kassie has bought me a brand new PDA, my old one stopped being a touchscreen one a few weeks back, and I’ve struggled using it, and it’s my main worktool!! I bought her and Mika some lovely jewellery, and some really nice clothes, a gorgeous emerald green silk dress for Kassie (and some sexy silk underwear for underneath!), and Mika I bought a sexy scarlet red prom dress, with some really cute elbow length silk gloves. I have yet to see them in their new clothes, Kassie still hasn’t took off her Santa dress (nope, not even this morning, we were all too excited! She wore the velvet red one, which I thought she might, she knows it’s my favourite!)

I’ll be here all night telling all my presents, but let’s just say no-one bought me a laptop, which I’m actually GLAD of, because I’m fussy about my mobile workmate, I like to take care of that buying decision, then I’m not embarrassed or disappointed. My close friend Pete bought me some lenses for my camera, which was a nice surprise, I’ve been having trouble with wide angles for a while, and a steering wheel and pedals for my 360, I’ve been getting angry with my pad on NFS Shift and Forza in front of him, so I think he definitely is good at getting subtle hints!

Dinner was like a banquet, with all the friends here! Kassie bought this really big cooker, a massive professional industrial size one, because she has dinner parties with business associates, and it came in really handy here!

I’ll blog some more, once the party animal in me dies down, and I have settled! I’ve been really excited today, it has been lovely! I’ve used our brand new Volvo B9TL double decker today, and it is a gorgeous machine. Rikky just spent the civilian equivalent of two houses cost on it! I’m used to driving them, but this one is custom decored inside, with red, black and blue, leather seating (including driver), air conditioning, built in CD Player, and is really nice to drive. New buses always are, and it wears off on you, but I get a feeling this one won’t! It’s nice to be able to drive a bus, in a friendly situation, and relax, with all your friends chattering away as passengers, bantering with them, instead of strangers.

Tomorrow I’m seeing the rest of family, I only got the chance to see my parents, before I was due to get back to Birmingham. Isn’t family time sweet at Christmas? It’s funny how humans make time for family so special once a year at Christmas, yet work seems to stop you all other times. I never see nor hear from most of mine the rest of the year, only my parents and some of their side.

Comments No Comments »