ChatGPT with internet database

[russy01]

Morning,

In my industry there are a couple websites which basically serve as a product databases. They are not retail websites, just huge sites with product information - images and all of the product information you could possibly think of for >500k products.

An example would be:

Product: XYZ
Product Type:
Status: Discontinued
Released: 2017
Features: XYZ
etc

I would like to be able to tap into this data easily to create content and suggestions for customers - I am not looking to create a customer facing experience.

Can I somehow use ChatGPT with all pages of X website as the database. Hoping I can ask it to find 10 entries that are discontinued and released in 2017 etc.

Is this possible, is it going to be any good? How do I do it?

Many thanks,

Russ

[jagnet]

No, that's not really a job for ChatGPT. It couldn't reliably store info on 500k products anyway. What's its current token limit? Something equivalent to 8k characters I think.

Sounds more like a simple web scraping task tbh. Parse the pages, feed the core data to ElasticSearch, and away you go.