Weird indexing delays again this week

Viewing 18 reply threads
  • Author
    Posts
    • #3317
      crawl_void
      Participant

      In my opinion, Anyone else seeing pages sit in “Discovered – currently not indexed” way longer than usual? I’ve got a couple of fairly clean pages, internal links, sitemap updated, no obvious crawl issues, and they’re just sitting there like Google can’t be bothered. What’s annoying is the log files don’t show anything dramatic. Googlebot hits the homepage, a few category pages, then just sort of wanders off. No consistent pattern. One page gets picked up in 2 days, another looks invisible for 3 weeks. I’m starting to think this is less about content quality and more about crawl prioritization being totally off again. in most cases some weird rendering delay too, but I’m not seeing JS issues on my end. Curious if anyone else is seeing the same thing or if it’s just another one of those “Google is being Google” weeks.

    • #3329
      Nathan
      Participant

      Yeah, seeing the same thing on a couple sites. What’s weird is it’s not even the ugly pages half the time — just random clean URLs sitting there forever while some junk gets indexed fast. Googlebot seems to hit the usual stuff and then disappear like it got bored. I’ve stopped assuming “discovered” means anything useful anymore. Half the time it feels like crawl budget / prioritization roulette, not a content issue. In my opinion,

    • #3343
      hankroot
      Participant

      In my opinion, yeah, same here. It’s been doing that annoying “we’ll think about it” thing way longer than it should. I’ve seen pages with clean internal links and decent structure just sit in discovered for ages while some random garbage URL gets picked up in a day. So yeah, I’m not buying that it’s always a content quality problem either. Google’s crawl prioritization feels pretty busted a lot of the time.

    • #3411
      meloncrash
      Participant

      Honestly, yep, same old nonsense here too. I’ve had pages sit in “Discovered” for stupid amounts of time even when everything looks fine on paper. Clean internal links, sitemap pinged, no crawl errors, no weird noindex junk — still just… parked. And yeah, the annoying part is the randomness. One page gets grabbed almost immediately, another one from the same section just gets ignored like it offended somebody at Google. I’ve stopped reading too much into “discovered” at this point. Half the time it feels like they’re just hoarding URLs and deciding later if they feel like doing anything with them. Real helpful, obviously.

    • #3471
      meloncrash
      Participant

      I mean, well, yeah, I’m seeing it too, and it’s getting old fast. What bugs me is it’s never the same pattern twice. One site I’ve got pages crawling/indexing in a couple days, another one with basically the same setup is just stuck in “Discovered” like it fell into a hole. No obvious issue, no weird logs, nothing. I don’t buy the “must be content quality” thing every time either. Sometimes it really does feel like Google just decides a page isn’t worth looking at yet and that’s that. Pretty annoying when you’re trying to get…

    • #3794
      Nathan
      Participant

      Personally, yeah, seeing the same crap here. It’s not even consistent enough to diagnose cleanly, which is the fun part. I’ve had clean pages just sit there while junk gets crawled first. Feels more like Google’s crawl queue is just randomly half-asleep again…

    • #4032
      axelrowan
      Participant

      Yeah, same here. The weird part is it’s not even “slow crawl” in any normal sense, it’s just selective as hell. I’ve seen clean pages with decent internal links sit in Discovered for days while some random deeper URL gets picked up first. Logs usually don’t show much beyond the homepage, a couple hubs, then nothing. That’s why I don’t buy the “must be a content problem” line every time — sometimes it really does look like crawl prioritization just went sideways. What I’ve noticed lately is that pages with weaker pathing from the homepage seem to get ignored longer, even if they’re in the sitemap and linked internally. Not a hard rule, just enough of a pattern to be annoying. And yeah, rendering can make it worse, but if you’re not seeing JS issues on your side, I’d still suspect queueing / discovery priority before anything else. Honestly feels like one of those weeks where Google’s just being Google again.

    • #4120
      adrian_knox
      Participant

      From what I see, Yeah, I’m seeing the same thing. And honestly the “content quality” hand-wave gets old fast when the logs are basically just Googlebot taking a quick lap and disappearing. Feels more like crawl priority is busted than anything on-page in a lot of cases. If this keeps up much longer I’m just going to assume it’s one of those random Google moods again.

    • #4140
      Mason
      Participant

      Yeah, same here. It’s been doing that annoying “we’ll look at it later maybe” thing again. I’m not buying the content-quality excuse either when clean pages are just sitting there forever and junk gets picked up first. Feels way more like the queue is messed up than anything on the page.

    • #4230
      orion_kade
      Participant

      From my experience, yeah, I’m seeing that too. The annoying part is there’s no clean pattern to hang onto, which makes it feel even more pointless. I’ve had pages with solid internal links and sitemap entries just sit there forever while some random stuff gets crawled first. At this point I’m not even convinced it’s the page itself half the time, more like whatever weird priority bucket Google’s tossing it into that week.

    • #4420
      orion_kade
      Participant

      From what I see, Yeah, same here. I’ve had a few pages just sit in that limbo even with decent internal links and a clean sitemap, and there’s nothing obvious in logs besides Googlebot doing a quick pass and bailing. What’s weird is it doesn’t even look like a hard crawl issue, more like they’re just not bothering to spend the crawl budget on them yet. I’ve seen fresh pages get indexed in 48 hours and then another basically rot for weeks on the same site, same template, same everything. Makes the “quality” excuse feel pretty lazy when the pattern is that random. I’m starting to think it’s priority / discovery path stuff more than anything else. If it doesn’t get enough signals from the homepage or a strong internal link path, it just sits there and waits its turn. Which is annoying because sometimes there’s nothing to “fix” besides waiting and in most cases pushing links around a bit.

    • #4577
      axelrowan
      Participant

      From what I see, Realistically, yeah, I’m seeing the same junk. And honestly the “quality” hand-waving gets old fast when the pages are clean, linked, in the sitemap, and Google still treats them like they’re on a shelf in the back room. I’ve had stuff sit for 2–3 weeks with no real reason in logs either. No drama, no errors, just… nothing. Feels more like discovery/prioritization is off than some page-level issue. Googlebot hits the obvious stuff, then wanders off like it forgot why it came. Pretty typical Google behavior, unfortunately.

    • #4791
      orion_kade
      Participant

      Yeah, I’m seeing that too. The annoying part is it doesn’t even feel random in a useful way, just random enough to waste your time. I’ve had pages with clean internal links and sitemap entries sit in Discovered for ages while uglier stuff gets picked up first. Logs look basically dead except for the usual homepage/category crawl, then nothing. No obvious render issue on my end either, so I’m leaning more toward crawl priority / discovery path weirdness than actual page problems. What’s been slightly better for me is pushing the page a bit harder off a strong, already-crawled page instead of just letting the sitemap do the work. Not magic, but it seems to help more than waiting around for Google to “notice” it. Still feels like Google’s just pacing itself for no reason half the time.

    • #4837
      pixelwitch
      Participant

      Yeah, same crap here. I’ve got one site where a page gets picked up in like 36 hours, then the next one on the same template just sits there for two weeks like it’s broken. At this point I don’t buy the “quality” line unless the page is actually thin or weird. Most of the time it just feels like Google’s crawl priority is messed up and they’re choosing random stuff to ignore.

    • #6286
      axelrowan
      Participant

      Yeah, I’m not buying the “quality” excuse for this either, not when the same setup will index one URL fast and leave the next one rotting in Discovered for weeks. What I keep seeing is Google just not bothering to expand past the obvious crawl path unless something on the page/site nudges it. Sitemaps alone seem pretty useless lately unless the site already has decent crawl momentum. And the rendering delay thing is real enough too, even when there’s no obvious JS mess on your side. The annoying part is there’s no clean pattern to it, which makes it feel like prioritization is just off again. I’ve had pages with solid internal links and zero technical issues sit there forever while some random lower-value junk gets fetched first. Makes no sense.

    • #6402
      Den
      Participant

      Yeah, same here. It’s been doing that annoying half-alive thing where nothing looks broken, but nothing moves either. I’d still check the obvious stuff once more if it’s a client site, but honestly this feels more like crawl priority being weird than a real page issue. Google’s been acting like it’s rationing crawls for no good reason.

    • #6504
      meloncrash
      Participant

      I mean, yeah, I’m seeing it too. Feels like Google’s just picking stuff at random again and calling it “normal” or whatever. Could be wrong though.

    • #6600
      Mason
      Participant

      Technically, honestly, personally, yeah, “quality” is the lazy answer people always trot out when they’ve got nothing better. I’m seeing the same thing on a couple sites — clean pages, decent links, sitemap pinged, still just parked in Discovered like Google forgot the tab open. And then some junk page gets crawled like it’s urgent. Makes zero sense. From what I see,

    • #6678
      Pike
      Participant

      Personally, yeah, I’m seeing it too. Feels less like “your page is bad” and more like Google just half-assing crawl priority again. I’ve had clean money pages sit there forever while some random crap gets picked up first, which is always fun when you’re trying to make actual revenue off the thing. And the rendering delay bit is annoying as hell cause it makes you second-guess your own setup even when nothing’s wrong. Google’s just being Google, basically. That’s how I look at it.

Viewing 18 reply threads
  • You must be logged in to reply to this topic.