fedora-infrastructure

Clone
Source Code
GIT

#12385 Missing stylesheet on the wiki page - partially
Closed: Fixed with Explanation a month ago by kevin. Opened 2 months ago by ilikelinux.

Closed: Fixed with Explanation
Reopen Issue

Since a fiew days now I do have issues with displaying correctly the wiki page :user/ilikelinux/grubby for example is without css.
I created a new subpage like :user/ilikelinux/grubby-cl-tool there it shows the correct css.

When do you need this to be done by?
ASAP

Sometimes I do have refresh several times. And sometimes refresh not works either.

That is being worked on by @kevin and @ryanlerch, it seems like some issue with caching on the proxies.

Metadata Update from @zlopez:
- Issue priority set to: Waiting on Assignee (was: Needs Review)
- Issue tagged with: low-gain, medium-trouble, ops
2 months ago

yeah, it seems like proxy09 is misbehaving somehow, but I have been unable to figure out why yet.

Hum, so I took proxy09 out of dns...

But now proxy14 is doing it. ;(

It looks like the proxy is caching the wiki without css. After refreshing several times it displays correctly. Could it be that flushing the dns on the proxys in general would help?

It does not seem to be any sort of cache or transient data (I have rebooted proxies and it still happens when they come back up)

It has to be something with the varnish config and the new theme...

TLDR: the two wiki servers are out of sync for theme content (I think)

OK, I've been digging into this today. Since I'm still getting up to speed on our infra, I'm putting all my notes/thoughts into the ticket.... so this is long,

  • Started by opening the inspector in Firefox, reloading the main wiki page a few times.
  • Noticed that the page loads were different between good and bad renders:
# Good render
Fedora_Project_Wiki     200     document        Other
load.php?lang=en&modules=mediawiki.skinning.interface%7Cskins.fedora&only=styles&skin=fedora    200     stylesheet      Fedora_Project_Wiki:9
load.php?lang=en&modules=startup&only=scripts&raw=1&skin=fedora 200     script  Fedora_Project_Wiki:10
fedora-bootstrap.css    200     stylesheet      Fedora_Project_Wiki:11
open-sans.css   200     stylesheet      Fedora_Project_Wiki:11
font-awesome.css        200     stylesheet      Fedora_Project_Wiki:11
hack.css        200     stylesheet      Fedora_Project_Wiki:11  477 B   41 ms
load.php?lang=en&modules=site.styles&only=styles&skin=fedora    200     stylesheet      Fedora_Project_Wiki:13  594 B   245 ms
Imagefedorawiki_logo.png        200     png     Fedora_Project_Wiki:24
ImageOverview-docs-icon.png     200     png     Fedora_Project_Wiki:60
page-script.js  200     script  content-script.js:38    13.2 kB 13 ms
ImageOverview-help-icon.png     200     png     Fedora_Project_Wiki:66
ImageOverview-contribute-icon.png       200     png     Fedora_Project_Wiki:74
ImageOverview-download-icon.png 200     png     Fedora_Project_Wiki:82
fontawesome-webfont.woff2?v=4.6.3       200     font    font-awesome.css
open-sans-v13-latin_latin-ext-regular.woff2     200     font    open-sans.css
open-sans-v13-latin_latin-ext-700.woff2 200     font    open-sans.css
open-sans-v13-latin_latin-ext-italic.woff2      200     font    open-sans.css
fedora-logo.png 404     text/html       Fedora_Project_Wiki:137
load.php?lang=en&modules=jquery%7Cskins.fedora.js&skin=fedora&version=1hybp     200     script  startup.js:1046
Otherfavicon.ico        200     vnd.microsoft.icon      Other
fedora-bootstrap.js     200     script  startup.js:1046 (memory cache)
open-sans-v13-latin_latin-ext-regular.woff2?1487f       404     font    load.php
open-sans-v13-latin_latin-ext-regular.woff?9c3db        404     font    load.php
open-sans-v13-latin_latin-ext-regular.ttf?94bec 200     font    load.php

# bad render
Fedora_Project_Wiki     200     document        Other
load.php?lang=en&modules=mediawiki.skinning.interface%7Cskins.fedora&only=styles&skin=fedora    200     stylesheet      Fedora_Project_Wiki:9
load.php?lang=en&modules=startup&only=scripts&raw=1&skin=fedora 200     script  Fedora_Project_Wiki:10
load.php?lang=en&modules=site.styles&only=styles&skin=fedora    200     stylesheet      Fedora_Project_Wiki:12
Imagefedorawiki_logo.png        200     png     Fedora_Project_Wiki:23
ImageOverview-docs-icon.png     200     png     Fedora_Project_Wiki:57
page-script.js  200     script  content-script.js:38    13.2 kB 13 ms
ImageOverview-help-icon.png     200     png     Fedora_Project_Wiki:63
ImageOverview-contribute-icon.png       200     png     Fedora_Project_Wiki:71
ImageOverview-download-icon.png 200     png     Fedora_Project_Wiki:79
redhat.png      404     text/html       Fedora_Project_Wiki:167
fedora-logo.png 404     text/html       Fedora_Project_Wiki:176
load.php?lang=en&modules=jquery%7Cskins.fedora.js&skin=fedora&version=1hybp     200     script  startup.js:1046
Otherfavicon.ico        200     vnd.microsoft.icon      Other

The different line-numbers in the calls from Fedora_Project_Wiki looked odd, like it was loading different versions of things. So I poked around in the wiki01 and wiki02 servers.

I found my way to the source dir, /srv/web/fp-wiki/ and looked around. I confirmed both were using the Fedora skin in LocalSettings.php. So I had a look in skins/Fedora - and then I spotted the 404 for redhat.png in the bad render. So I grepped for that, and lo:

# wiki01
$ grep redhat.png -r skins/
skins/Fedora/FedoraTemplate.php: 'src' => '/w/skins/Fedora/resources/images/redhat.png',

# wiki02
$ grep redhat.png -r skins/
(no hits)

On further inspection many of the files are different:

# wiki01
4232d963629c0134e7e3b6032b001b5b  skins/Fedora/Fedora.php
1634139efc018aade415dca4ade445e0  skins/Fedora/Fedora.skin.php
abbc67185a65f7de70ab400870d8c82e  skins/Fedora/FedoraTemplate.php
59530bdf33659b29e73d4adb9f9f6552  skins/Fedora/LICENSE
1b437a414df2f66ef1e3e95174720b4d  skins/Fedora/skin.json

# wiki02
4232d963629c0134e7e3b6032b001b5b  skins/Fedora/Fedora.php
8d64ac7271b290febb3c8b4501b3f412  skins/Fedora/Fedora.skin.php
8476c44cc0f6618de331d2b4525dff22  skins/Fedora/FedoraTemplate.php
59530bdf33659b29e73d4adb9f9f6552  skins/Fedora/LICENSE
27ddb15bfe88d0e74a2e374db7dbad85  skins/Fedora/skin.json

The date stamps are different too, wiki01 is newer than wiki02. I went back and reloaded the page a few more times, and observed that failed renders always seem to come from wiki01. That's odd, given wiki01 is newer, but in any case, this appears to be the cause of at least some of the issues.

@zlopez re-ran the Ansible role, but it didn't touch that dir, so now I'm going to see if I can fix the role.

wiki02 has mediawiki-skin-fedora-0.14-1.fc40.noarch . wiki01 has mediawiki-skin-fedora-0.16-1.fc40.noarch . That's the difference in files.

Not sure if this means 0.16 is broken or just that things are broken because each query might hit 01 or 02, so if they don't have the same files things are obviously going to go wonky. We can downgrade mediawiki-skin-fedora on wiki01 for now, I guess?

I've done that, and a few test loads I just did all came up good. I guess we need @ryanlerch to take a look and see if 0.16 is busted. Or we can try updating both boxes to 0.16 and see if it works OK then...

ok, ryanlerch gave the go ahead so I updated both to 0.16 now. seems to be working from some initial tests. is it OK for everyone else too now?

Yep. Lets close.

Thanks @gwmngilfen for the good detective work!

Metadata Update from @kevin:
- Issue close_status updated to: Fixed with Explanation
- Issue status updated to: Closed (was: Open)
a month ago

Log in to comment on this ticket.

Metadata
None

low-gain medium-trouble ops

None
None
Waiting on Assignee
Boards 1
ops Status: Backlog
Powered by Pagure 5.14.1
Documentation • File an Issue • About • SSH Hostkey/Fingerprint
© Red Hat, Inc. and others.