Why are my preview=true urls all of sudden crawlable with Ahrefs and Screaming Frog?

williamf
williamf Member Posts: 19
edited April 9 in Ask a Question

[UPDATE]

I narrowed this down to links in the new accordion widget are using preview links unless you enter a specific web address. Whenever I update the widget on older pages it converts all the links to preview=true links, and even if I remove them and add them again it is still using preview links.

In the past week I am seeing my preview urls being crawled by Ahrefs and Screaming Frog and they are all returning a 404.

Example URL: https://www.magnetfishingisfun.com/site/a332f4db/where-to-magnet-fish?preview=true&nee=true&showOriginal=true&dm_checkSync=1&dm_try_mode=true

These were not being crawled until just this past week and I can't figure out why, any help would be appreciated.

Answers

  • williamf
    williamf Member Posts: 19

    I narrowed this down to links in the new accordion widget are using preview links unless you enter a specific web address. Whenever I update the widget on older pages it converts all the links to preview=true links, and even if I remove them and add them again it is still using preview links.

Categories