User talk:Rob Kam

InternetArchiveBot on scruffywiki

Hi, The deployment of InternetArchiveBot on scruffy wiki has been stalled due to all pages apart from the main page being only viewable by admins. For more information see w:phab:T257204 --Nintendofan885 (talk) 07:00, 11 September 2020 (UTC)

Thanks for that, should be fixed now. --Rob Kam (talk) 08:13, 11 September 2020 (UTC)

wikiteam3 issues

What issues do you have with wikiteam3? On Python 3.9.14 under Linux, with the latest git from the python3 branch of elsiehupp/wikiteam3, I was able to successfully make a dump of mh:advancewars, with all revisions and images. OrangeStar (talk) 16:02, 15 December 2022 (UTC)

Just compiled and tried with the latest Python, 3.11.1, and same, no issues. OrangeStar (talk) 16:30, 15 December 2022 (UTC)

Thanks for checking this. Yes dumpgenerator --failfast --xml --xmlrevisions --api=https://advancewars.miraheze.org/w/api.php works fine. Try dumpgenerator --failfast --xml --xmlrevisions --api=https://sdiywiki.miraheze.org/w/api.php --Rob Kam (talk) 16:50, 15 December 2022 (UTC)

You're right, it crashes when attempting to backup your wiki. The error is wikiteam3.dumpgenerator.exceptions.PageMissingError: page 'Template:Str left' not found, however that page clearly exists in your wiki, so it must be something else. I'll see what I can do. OrangeStar (talk) 18:50, 15 December 2022 (UTC)

That would be great of you! I have posted about the error to the wikiteam3/issues on GitHub but it seems that the lead coder Elsie Hupp is currently having to deal with other work. Rob Kam (talk) 19:17, 15 December 2022 (UTC)

Using a professional debugger trusty print statements everywhere, I figured out the error. It's not because of Wikiteam, its actually a server side error.

Wikiteam crashes on this revision of Str left. If you go to that link, you'll see the error "MediaWiki\Revision\RevisionAccessException" ([eaa05a41f9ff86d098eaac64] 2022-12-15 19:52:01: Fatal exception of type "MediaWiki\Revision\RevisionAccessException"). This is not something wikiteam can fix.

It complains that it doesn't exist because the server doesn't return anything when trying to retrieve the wikitext, basically. OrangeStar (talk) 19:57, 15 December 2022 (UTC)

I'll file a Phabricator task, the Miraheze sysadmins are the only ones that can fix this. OrangeStar (talk) 19:58, 15 December 2022 (UTC)

For reference, the phabricator task is phab:T10155. OrangeStar (talk) 20:03, 15 December 2022 (UTC)

Wow! Many thanks. Rob Kam (talk) 20:14, 15 December 2022 (UTC)

@OrangeStar I've copied, deleted and pasted/recreated the pages with corrupted revisions - none were important. Now it runs to completion. However now the problem is that most of the XML is missing. I've posted this as an issue at wikiteam3/issues Rob Kam (talk) 00:54, 16 December 2022 (UTC)

I just made a backup of your wiki and got a 120.3MiB XML file, it seems to be working OK. I do get the same output with grep here, but it's likely an issue with the syntax of the command (I also don't know what that command is looking for). Xmllint also returns no syntax errors, and quick analysis of the file with the same tool indicates everything is in order. OrangeStar (talk) 09:59, 16 December 2022 (UTC)

Thanks for helping out with this!

I was wrong, the XML is there. For comparison the SRE did a dump on the 10th it's at https://static.miraheze.org/sdiywikiwiki/dumps/sdiywikiwiki10122022.xml The grep line above is from the Wikiteam tutorial at https://github.com/WikiTeam/wikiteam/wiki/Tutorial along with an explanation of what it's checking for. The SRE dump passes the check as does dumpgenerator --failfast --xml --curonly --api=https://sdiywiki.miraheze.org/w/api.php.

Besides later edits, I'm still trying to find the difference between the SRE and Wikiteam3 --xmlrevisions versions that causes that grep command to give all 1s. Rob Kam (talk) 15:15, 16 December 2022 (UTC)

Changing all the \n to carriage return + newline seems to fix it. Rob Kam (talk) 15:27, 16 December 2022 (UTC)

The "error" is that grep -c doesn't count a single /n as a newline, and it only counts 1 match per line. As it thinks the file is just one big line, it returns 1 every time.

The "fix" would be to use grep -o instead, piping the output to wc -l. This requires a more complicated script, but should work out of the box. I'll publish the script somewhere, once I finish writing it of course.

I don't recommend changing all /n to carriage return + newline, as MediaWiki revisions have a sha1 hash on them, and the wikitext uses /n as newline. Changing it would make MediaWiki complain that the revisions are corrupted, making the dump kinda useless. OrangeStar (talk) 16:04, 16 December 2022 (UTC)

Is it not that the dumpgenerator script should be writing a newline but instead is printing the characters \n in the XML, putting it all on one far too long line? Rob Kam (talk) 16:18, 16 December 2022 (UTC)

Yeah basically, all grep -c sees is just a single long line. Editing the source code to make dumpgenerator put stuff on newlines would be too much work for me, and probably not a trivial change. Making a script using grep -o and wc is much easier than editing the source code to implement a purely aesthetic change. Also, even if the backup fails the grep -c check, it's still good as long as there are no syntax errors (which is basically what it's trying to check, that every tag is properly closed). OrangeStar (talk) 16:23, 16 December 2022 (UTC)

Thanks again. Don't worry about fixing the grep line. I'll try to get Elsie, the script's coder to fix dumpgenerator.py. Rob Kam (talk) 16:30, 16 December 2022 (UTC)

Sure, but I reiterate, that would be a purely aesthetic change, for the purposes of a backup, current behavior is OK. There's not actually an error in need of fixing. OrangeStar (talk) 22:47, 16 December 2022 (UTC)

Regarding your vote on Make the datadump-related rights available when selecting grants

Hi, I've removed your vote on Make the datadump-related rights available when selecting grant as is voting not open at this time. Thank you for understanding. --Blad (talk • contribs • global) 12:39, 19 December 2022 (UTC)

simpleelectronics

Hi Rob,
Are you going to keep it private? Only the main page is available.
Thanks.
---Imamy (talk) 11:25, 17 December 2023 (UTC)

It's now at https://simpleelectronics.wikitide.com/. Thanks for asking. Rob Kam (talk) 11:48, 17 December 2023 (UTC)

Please be careful while editing large pages

Please be careful when editing large pages. You seem to have removed part of a comment. It could be due to an edit conflict, but if you get an edit conflict, you should not resume it, but go back and do the edit again in the new revision. It's better to edit a section in stead of the whole page.  Kind regards,   Rodejong   ^💬 Talk ^✉️ Email  ^📝 Edits   Auth →  11:34, 13 April 2024 (UTC)

Oops! Thanks for spotting that and fixing it. I'll try to be more careful in future. --Rob Kam (talk) 12:27, 13 April 2024 (UTC)