OpenAI’s bot destroyed the seven-person company’s website ‘like a DDoS attack’

Open AI bot destroyed the seven people’s company website. Open AI was relentlessly attempting to scrape the entire site.
“We have over 65,000 products, each product has a page,”
“Each page has at least three photos.”
OpenAI was also sending “tens of thousands” of multiple server requests who tried to download all of it. Hundreds of thousands of photos and detailed descriptions are there.
“OpenAI used 600 IPs to scrape data, and we are still analyzing logs from last week, perhaps it’s way more,”
He also said it was according to the IP addresses and the bot used to attempt to consume his entire site.
“Their crawlers were crushing our site,” he said “It was basically a DDoS attack.”
Triplegangers’ website is its business. This company spent over the decade assembling what it calls the largest database of human digital doubles on the web. The 3D image files are scanned from the actual human models.
It sells all the 3D object files and photos. They sell everything from hands to hair, skin, and full bodies. To the 3D artists video games and anyone who needs to digitally recreate the authentic human characters.
The entire Tomchuk team is based in Ukraine. They are also licensed in the U.S. out of Tampa, Florida. They have multiple terms of service pages on their site. They forbid bots from taking the images without permission and alone did nothing. The website properly configures the robot.txt file with the tags specifically telling the Open AI’s bot GPT bot to leave the site alone.
Robot.txt, otherwise known as the Robots Exclusion Protocol. It can tell the search engine sites what not to crawl as they index the web. Open AI addresses it as the informative page and it honors such files when configuring it with its own set of do-not crawl tags. It also warns that can take its bots up to 24 hours to recognize an updated robot.txt file.
Tomchuk experienced if any site isn’t properly using robot.txt. OpenAI takes that to mean they can scrape to their heart’s content. To add insult to injury that only was Triplegangers knocked offline by Open AI. Robot.txt also isn’t a failsafe. AI companies voluntarily comply with it. Another AI startup Perplexity pretty famously got called out last summer by a wired investigation when some new evidence impiled the Perplexity.
AI companies voluntarily comply with it. Another AI startup, Perplexity, pretty famously got called out last summer by a Wired investigation when some evidence implied Perplexity wasn’t honoring it.