Kindly let me know how to get in touch with you! Alternatively, feel free to message me, contact info on profile

That's an interesting idea, thinking about it.

The plan is to address all SEC forms anyways so this will be a natural extension

I checked IPs on those, they belonged to MSFT

Wow this is interesting. I launched my site like a week ago, only submitted to google. But all the crawlers (especially the SEO bots) mentioned in the article were heavily crawling it in a few days.

Interestingly, openai crawler visited over a 1000 times, many of them for "ChatGPT-User/1.0" which is supposed to be for when a user searches chatgpt. Not a single referred visitor though. Makes me wonder if it's any beneficial to the content publishers to allow bot crawls

I ended up banning every SEO bot in robots.txt and a bunch of other bots

Yeah Openrouter is generally better. Only exception is when some API is launched but not yet on openrouter, rare though