I want to help fix fusor.net!! (join up listing)

Announcements and items of immediate importance.
User avatar
Richard Hull
Moderator
Posts: 12196
Joined: Fri Jun 15, 2001 1:44 pm
Real name: Richard Hull

I want to help fix fusor.net!! (join up listing)

Post by Richard Hull » Fri Nov 08, 2019 11:44 am

This is a repository of the names of those willing to help repair their old posts by replacing or updating their missing attachments.
Here is how it is done once you have privileges granted.

Go to your damaged report. click on the "pencil icon" to edit your post. Scroll all the way down to the Attachments tab and click on "add files". Have you new or original attachments in mind. now, delete all the old files. Now re-click on "add files" a blank line will open and now start to re-insert you new images and attachments one by one. once done, click submit above and your old post will have the new images attached.

***********************************************************************************************************************************
If you have the guts and verve to wish to repair some of you old post's attachments that have gone missing just reply and simple state "Billy Jones wants editing privileges" and close it out.
In this matter, we will have a list of folks who stand ready to help out should the admins desire to give you the editing privilege.
NOTE: All of the powers that be here take the editing privilege as a sacred gift.
If you should be granted this gift, do not abuse it! Never ever delete one of your own posts. Feel free to correct spelling, punctuation or to add text to make the post more clear in your second pass.
Remember, your main mission is to delete the old, now failed, attachments and re-install your images or any new ones that you feel would further enhance your post.
*************************************************************************************************************************************

To join this group of helpers, Just reply to this message and type one line.....

I, John Smith want my personal editing privileges restored

hit submit.

Richard Hull
Progress may have been a good thing once, but it just went on too long. - Yogi Berra
Fusion is the energy of the future....and it always will be
Retired now...Doing only what I want and not what I should...every day is a saturday.

User avatar
Paul_Schatzkin
Site Admin
Posts: 740
Joined: Thu Jun 14, 2001 4:49 pm
Real name: aka The Perfesser
Contact:

Re: I want to help fix fusor.net!! (join up listing)

Post by Paul_Schatzkin » Fri Nov 08, 2019 8:16 pm

If anybody wants to sign up for this mission, great, we might still need some help but first...

For once we've got some good news about all this: after about 2 hours of digital spelunking this afternoon, we have finally found a trove of image files from one of the earlier iterations of the fusor.net site.

We still haven't figured out precisely how we are going to reconcile what we've found with the database that delivers images to the posts, but at least we have a lot of previously-thought-to-be-lost images to work with.

If it does come down to the kind of manual, post-by-post effort that Richard is anticipating, we'll need all the help we can get.

Thanks,

--_S
Paul Schatzkin, aka "The Perfesser" – Founder and Host of Fusor.net
Author of The Boy Who Invented Television - http://farnovision.com/book.html
"Fusion is not 20 years in the future; it is 50 years in the past and we missed it."

John Futter
Posts: 1604
Joined: Thu Apr 22, 2004 2:29 am
Real name: John Futter
Contact:

Re: I want to help fix fusor.net!! (join up listing)

Post by John Futter » Sat Nov 09, 2019 6:48 pm

I John Futter want my editing privileges restored

User avatar
Bob Reite
Posts: 388
Joined: Mon Aug 26, 2013 1:03 am
Real name: Bob Reite
Location: Wilkes Barre/Scranton area

Re: I want to help fix fusor.net!! (join up listing)

Post by Bob Reite » Sun Nov 10, 2019 3:35 am

I Bob Reite want my editing privileges restored.
The more reactive the materials, the more spectacular the failures.
The testing isn't over until the prototype is destroyed.

Jon Rosenstiel
Posts: 1391
Joined: Thu Jun 28, 2001 5:30 am
Real name: Jon Rosenstiel
Location: Southern California

Re: I want to help fix fusor.net!! (join up listing)

Post by Jon Rosenstiel » Sat Dec 07, 2019 1:22 am

I, Jon Rosenstiel, want my editing privileges restored.

User avatar
Frank Sanns
Site Admin
Posts: 1693
Joined: Fri Jun 14, 2002 6:26 pm
Real name: Frank Sanns
Location: Pittsburgh, PA USA

Re: I want to help fix fusor.net!! (join up listing)

Post by Frank Sanns » Sat Dec 07, 2019 2:11 am

All have been granted as you ask.

You will notice that the color of your name will be light green to signify being "light moderators". This means that you can edit your own as well as other members posts. Please only repair attachments and do not change or delete any other content. We do not want any hanging threads or any other structural changes as we work though this.

Thank you all for the efforts to repair the site.

Andrew Seltzman
Posts: 747
Joined: Mon Feb 02, 2004 1:02 am
Real name: Andrew Seltzman
Contact:

Re: I want to help fix fusor.net!! (join up listing)

Post by Andrew Seltzman » Sat Dec 07, 2019 3:45 pm

I, Andrew Seltzman, want my editing privileges restored.

If we overwrite a broken attachment with a similar/newer/clearer file, will this confuse a later possibly automated fix?
Andrew Seltzman
www.rtftechnologies.org

User avatar
Frank Sanns
Site Admin
Posts: 1693
Joined: Fri Jun 14, 2002 6:26 pm
Real name: Frank Sanns
Location: Pittsburgh, PA USA

Re: I want to help fix fusor.net!! (join up listing)

Post by Frank Sanns » Sat Dec 07, 2019 8:13 pm

A conditional statement could be put into a script is an active or newer photo is there so I would say go for it.

Rex Allers
Posts: 431
Joined: Sun Dec 30, 2012 8:39 am
Real name:
Location: San Jose CA

Re: I want to help fix fusor.net!! (join up listing)

Post by Rex Allers » Sun Dec 08, 2019 3:35 am

Andrew Seltzman,

I was worried too about all the random repair of missing files. Having only normal user privileges, I have been browsing around the forum and as of yesterday I think I understand what the problem is. I no longer have very much hope of an automated fix, although it would be possible with a good backup from before the site move.

A while back I had noticed that it seemed to be related to certain users. After finding a post with a missing attachment file, I could look at the profile for that user and get the list of all their posts. Randomly browsing through their messages, I never found any post they made that had an intact attachment; any attachment files they had uploaded were all missing.

So I concluded that the UserID number of the poster was a key factor. My instincts had me thinking that there should be a consecutive block of UserID numbers with the problem. What I found didn't seem to fit that conjecture. One member with the problem had recently joined, Joe Gayo (4450). Another user was a very early member, Richard Hull (58). Many users with ID numbers between had posts with no problems. I couldn't see a pattern.

Yesterday, Andrew Robinson provided a post where he gave a spreadsheet list of the files that were missing and some other details.
Re: Senior users, Admins and Moderator - help us make repairs
Andrew Robinson » Thu Dec 05, 2019 7:12 pm
viewtopic.php?f=47&t=13089#p85087

I sorted using column A of that list (the attachment filenames as stored for the BB use) and looking at that, finally the pattern hit me. The current user IDs can be 2, 3, or 4 digits long. The members with the problem have UserIDs beginning with 4 or greater. So, UserIDs in these ranges:
40 to 99,
400 to 999,
4000 to 9999 (but the current highest ID is in the 6000s.)

I'm not sure if 40 or 400 or 4000 is the exact crossover boundary for UserIDs with the problem, but it should be very close. (Maybe it could be something like 41, 410, 4100.)

I'll follow this post with another giving the list of UserIDs having missing files that I have extracted from Andrew R's list of missing files. Although maybe not exactly right as things get fixed, there are 167 members on that list with 3595 missing files.

For some of the UserIDs in my list I looked up and added the associated username. For that I was using a manual method and gave up on trying to do most of the list. The are ways a normal user can find their own UserID or look up the profile of a member using their UserID number. I'll try to add another post describing that.

--- What happened and how did it happen? ---
I don't know if we will ever be sure but I have a plausible explanation. First I'll provide some descriptions of how attachments work on a phpBB forum. I'm not an expert but after some research, I think this is accurate enough for our purposes.

Attachments in a phpBB forum

Each phpBB setup has an associated database. The database contains some configuration info and also holds the text content and associated information for each post made on the forum (poster, text of the message, location of the post in the site structure, time/date, etc.)

When a member makes a post they have the option to upload one or more attachment files to include in the message. Usually this file will be a picture (jpg, png, ...) but could also be something else like a document (pdf, doc, ...). When a file is uploaded, the post part of the database records that there is an attachment. Other parts of the database record info about the uploaded file (original filename, poster, date/time, size, ...).

All uploaded files for all users are saved in a directory. The default for this directory's name is '/files'. Before a new file is saved, its filename is changed. The new filename has two parts separated by an underscore character. The beginning of the new name is the numeric UserID of the poster, then the underscore, then a long generated hexadecimal number to make this name unique on the site.

Here's an example of one generated filename:
58_b0522fc1c31a94b1662c97fca7301104

This was uploaded as an attachment by Richard Hull (UserID = 58). From Andrew R's spreadsheet list, it originally was the file '13.jpg'.

Here's another one uploaded by Tyler Meagher:
4251_33e437d386b95d24ceffaff6260df834

Tyler has a much higher UserID starting this filename (4251).

These renamed attachment files are all stored in the '/files' directory. If you sort their names in alpha-numeric order the files beginning with 2n will be close in the list to 2nn or 2nnn.

What happened?

Who can say for sure? My speculation is that the backup of the files directory from the old site when preparing for the move, was not complete. For whatever reason, the symptoms of the problem seem to indicate that all the filenames beginning with 4 or greater did not make it into the /files directory on the new site. Because the beginning of the filenames is the UserID of the poster, it has caused all the attachments by certain users to be lost.

After the site move, any user making a new post with an attachment will have the process work properly with a new attachment file added in the /file directory. If an old message is edited with a new uploaded file to replace a missing one, that should (and seems to) work correctly to add a new file in the /files directory.

Could there be a bulk fix for this problem? I think yes, if there is a backup saved somewhere of the phpBB forum on the old site that contains the /files directory. The backed up files could be sorted alpha-numerically and the files beginning with 4 or greater copied into the present site /files directory.

Would that bulk copy hurt any of the repair work that has already been done? I doubt it. Each of the new files from making changes since the move would have a new unique filename generated for it. The database entries for the post should now point to this new filename. So if a group of old files was merged into the current /files dir I would expect any missing files that have already be fixed to have a name that is no longer pointed to in the database, so the added old files would just use a bit of extra space in /files without breaking any work already done to replace them.

I'm not directly involved with any of the processes related to maintaining the site, nor do I even have any privileges beyond a basic member. I would have hoped there would be multiple backups of the old site saved somewhere. From the most recent good one, many of the files could be extracted and merged. Even a very old backup should be able to provide many of the missing files. From reading the many messages related to trying to understand and repair the problem, I am somewhat shocked and disappointed that I have not heard any indication that such backups exist.

If no such backup exists to get some of the missing files, the only hope is to manually replace missing files one at a time. Some of that can be done and any repair will help. I gather that there are around 3500 attachment files that have been lost. I would expect most of them may never be recovered or replaced. Some members who posted are no longer around to even try to remember the missing content and for many attachments I'd be surprised if the original content still exists somewhere.

PS for Andrew Seltzman,
Your user ID is 344 so you shouldn't have any posts that need fixing.
Last edited by Rex Allers on Sun Dec 08, 2019 9:29 am, edited 2 times in total.
Rex Allers

Rex Allers
Posts: 431
Joined: Sun Dec 30, 2012 8:39 am
Real name:
Location: San Jose CA

Re: I want to help fix fusor.net!! (join up listing)

Post by Rex Allers » Sun Dec 08, 2019 3:37 am

Using the spreadsheet list that Andrew Robinson created and shared, I was able to process and create a list of the UserIDs of members who have one or more missing attachment files in their posts.

For a small number of these I looked up the user's name and added it after the ID number. I was using a slow manual process to get the names, so I gave up after a while.

I hope members will look up their own UserID number and check if they are in this list. If you are in the list it means that one or more post you made has lost an attachment file you uploaded and could benefit if you can edit and replace any missing files.

I'll add another follow-up post describing how any member can get their UserID number.

------
55,r_c_edgar
56,Paul_Schatzkin
58,Richard Hull
59,ningauble
63,Tom Dressel
64,DaveC
67,Jon Rosenstiel
69,raneyt
70,teslapark
72,ijv
73,Richard Hester
74,3l
79,plasmann
81,Carl Willis
83,SteveHansen
87,Mike Veldman
99,Starfire
408,John Futter
409,
436,
437,
438,
444,
453,
455,
459,
464,
475,
487,
489,
490,
496,
503,
504,
516,
517,
518,
527,
532,
540,
542,
555,
559,
565,
580,
596,
599,
600,
608,
611,
615,
624,
627,
629,
630,
639,
642,
651,
665,
668,
677,
683,
685,
691,
694,
697,
701,
702,
711,
717,
721,
728,
731,
733,
735,
740,
742,
747,
764,
773,
776,
785,
806,
810,
820,
829,
834,
836,
853,
864,
867,
875,
876,
882,
883,
891,
892,
894,
907,
909,
913,
914,
917,
920,
928,
942,
943,
959,
969,
970,
986,
992,
997,
4025,Michael Bretti
4046,
4150,
4159,
4164,
4174,
4192,
4199,
4202,
4209,
4212,
4214,
4220,
4246,
4251,Tyler Meagher
4260,
4262,
4280,
4283,
4299,
4302,
4303,
4303,
4308,
4315,
4324,
4330,
4339,
4340,
4359,Cristiano Machado
4360,
4373,
4387,
4393,
4402,
4405,
4406,
4411,
4417,
4424,
4429,
4440,
4443,
4444,
4450,Joe Gayo
4460,
4507,
4510,
4554,
4568,
4582,
4610,
4685,
4723,
Last edited by Rex Allers on Sun Dec 08, 2019 9:40 am, edited 1 time in total.
Rex Allers

Post Reply