Techy folks, can anyone help Pet of The Day?

Kentuckienne

Supporting Vendor
Oct 9, 2016
2,742
1,632
Middle of nowhere (kentuckianna)
Parrots
Roommates include Gus, Blue and gold macaw rescue and Coco, secondhand amazon
I've been working with the Wayback downloads team to recover the lost Pet Talk forum from Pet Of the Day. The site was backed up in 2015, so all the forum files since then were lost - about two years worth. But the Wayback team says the files are huge and they are having difficulty recovering them. The last email said:

"we are trying one more method, however this one takes longer:

PetoftheDay.com
Depth: 0 (Entire Site) | URLs: 61,736 | Copied: 5,186 | Failed: 6,573 | Skipping: 0 | Pending 49,977 (Extremely Large URL Queue!)
Running | Server Runtime: 16 hrs, 06 mins | Real Time: 16 hrs, 33 mins | Parse Time per URL: 4.93 secs | Estimated Time Remaining 34 hrs, 13 mins (Extremely Long Time Frame!)

this is what is done so far.

as far as the info we have now, its possibly someone could write a script to make it work ( or a .htaccess rewrite)


Please advise."


I think they have something like 13 GB of files downloaded ("we're trying to get it but it has so many queries to get to a page that doing a find and replace isnt working")

I've asked for some clarification of what kind of scripting might be needed. Is anyone from Parrotforums able to help out with writing such a script and assisting with the file recovery?
 

SailBoat

Supporting Member
Jul 10, 2015
17,669
10,064
Western, Michigan
Parrots
DYH Amazon
Sound like that server has been sick for a while.

You are going to need someone that knows server software language and that would 'likely' require the knowledge of what software it is and what rev.

Also, I'm bumping this back up the board!!!

FYI: PM David in Florida, if nothing else he may know where to point you!
 

Taw5106

New member
Mar 27, 2014
2,480
25
Texas
Parrots
Buddy - Red Crowned Amazon (27 yo)
Venus - Solomon Island Eclectus (4 yo)
Buzz CAG (2 yo)
Sam - Cockatiel 1997 - 2004
Tweety - Budgie 1984 - 1987
Sweety - Budgie 1985 - 1986
Need details on the server, OS, age, what happened and current patch versions (windows). Doesn't sound like Windows though.


Sent from my iPhone using Tapatalk
 
OP
Kentuckienne

Kentuckienne

Supporting Vendor
Oct 9, 2016
2,742
1,632
Middle of nowhere (kentuckianna)
Parrots
Roommates include Gus, Blue and gold macaw rescue and Coco, secondhand amazon
  • Thread Starter
  • Thread starter
  • #4
The server was restored from a backup, but the forum "pet talk" hadn't been backed up in two years. Sorry I wasn't more clear, I forget everybody doesn't know about Wayback. Remember the Wayback Machine from Mr. Peabody? Well, there is a web crawler that has links and copies of just about anything online. If you can find a working copy of a file, website, whatever then for a very small fee this team will download it, stitch it together, and send you a link. So the files I'm asking about are files the team downloaded, but they are having a bear of a time trying to make a workable forum out of it. I'm hoping that someone here would be able to look at the dump and write a script to parse it back into a forum, even if it's just read-only. Here's their site:

https://www.waybackdownloads.com/
 

Scott

Supporting Member
Aug 21, 2010
32,673
9,792
San Diego, California USA, Earth, Milky Way Galaxy
Parrots
Goffins: Gabby, Abby, Squeaky, Peanut, Popcorn / Citron: Alice / Eclectus: Angel /Timneh Grey: ET / Blue Fronted Amazon: Gonzo /

RIP Gandalf and Big Bird, you are missed.
Wish I could help or offer guidance. I am barely able to accomplish the most basic of internet functions!
 

PetoftheDay

Member
Dec 27, 2010
967
1
Boston area, MA
Thanks, I appreciate any help people can offer. Right now I am at at standstill with uploading a 14GB file of images people had posted - tech support at the hosting company is working on that one.

If anyone has any Linux ability there are a couple scripts that you might be able to help me with, just need someone trustworthy. My husband wrote code more easily than sentences in English - he was a native speaker of the language, born and raised here, but rules in English are illogical and get broken as often as they are followed!

Miss that boy every day, it has been 2 years and now 15 days since his death, so the crash happening within days of the anniversary has not made it any easier.
 
OP
Kentuckienne

Kentuckienne

Supporting Vendor
Oct 9, 2016
2,742
1,632
Middle of nowhere (kentuckianna)
Parrots
Roommates include Gus, Blue and gold macaw rescue and Coco, secondhand amazon
  • Thread Starter
  • Thread starter
  • #7
Update: I'm emailing the way back folks...seems the script they have is working, it's just going to take a week to run and that's really too much to ask of them. I'm waiting to hear what platform is needed to run the script, but I can't do it myself - I'm on limited data. When I hear back I will post here and maybe PM some folks who have been careless enough to let their computer savvy show!
 

Flboy

Well-known member
Dec 28, 2014
12,599
4,105
Greater Orlando area, Florida
Parrots
JoJo, 'Special' GCC, Bongo, Cinnamon GCC(wife's)
I am glad you are on a road to recovery! My Son-in-law, a coder, could only offer this:

"Sorry for late reply, got in from work and crashed. At 55 hours this week catching up from vacation.


They are not screwed but it is a lot of labor to get that data into a working forum. Way back has raw data not SQL table structure so for someone to comb the data and turn it back into the table structure needed would be a regex guru or someone who has a lot of time to parse a CSV file and count commas and turn them into a working table structure that is compatible with their current forum tables. "
 
OP
Kentuckienne

Kentuckienne

Supporting Vendor
Oct 9, 2016
2,742
1,632
Middle of nowhere (kentuckianna)
Parrots
Roommates include Gus, Blue and gold macaw rescue and Coco, secondhand amazon
  • Thread Starter
  • Thread starter
  • #9
Wayback Downloads team has a script that's working, doing just that, parsing the data. I'm going to be staying somewhere with broadband so I just wrote asking if I could download the files they created and run the script offline. I live in the big time sticks, so my internet at home is a metered cellular connection and a 12 GB download would kill me. I used to do SQL in a previous incarnation but I've forgotten everything. It doesn't take much computing power to run the script, just more bandwidth than I have, so I hoped someone might have a pc and a fat pipe that could run for a week.

We will get there one way or the other.
 

Terry57

Moderator
Staff member
Super Moderator
Nov 6, 2013
47,637
Media
47
Albums
13
38,970
Spruce Grove, Alberta, Canada
Parrots
Hawkhead(Darwin),YCA(Dexter),VE (Ekko),OWA(Slater),BHP(Talli),DYH(Calypso),RLA(Kimera),Alex(Xander)CBC(Phoe),IRN (Kodee,Luna,Stevie),WCP (Pisces),CAG(Justice)GCC (Jax), GSC2(Charley)
I am so sorry this happened! Kentuckienne, I think it is so wonderful that you are helping with this. This is way beyond my skill set, but am bumping it back up and keeping my fingers crossed that someone can help.
 

Most Reactions

Latest posts

Top