Hi all,
My first post here so please be gentle 
I’m not a code writer, so please be even more gentle 
There’s a government database which is updated on a daily basis. I’d like to find the best, and most reliable/stable, method of grabbing this database everyday and update a Google Sheet.
There are two options to access this database:
- Download CSV
- HTTP request
Is there a way that can avoid having to itirate new rows into Google Sheets? I know about this bulk option via the API, but that’s still a big of an overkill I think.
Thanks
Hi @Test_Test ,
It all depends on how the government database is updated. If they just add new records you can store somewhere the ID (if sequential) or the created timestamp of the last record added to your Google sheet. Then for each new run, you look that value up and only add records that have been added after your last run.
This could work with updated records to if the database has a column for last update.
1 Like
Hi @Test_Test
Ideally for this you will need to use the bulk import API for google sheet. Make has JSON app that can easily create the JSON payload of all the rows you get from CSV, you dont have to use HTTP, rather Google sheet app has API action where you can just use the JSON.
1 Like
Hi,
So I’m trying to make option 1 work.
I trying to use HTTP=>Get File:
I’m doing something wrong, as the output isn’t the actual CSV file:
Yes, I know, I’m doing something very wrong on a very basic level. As said before, be gentle
My logic is based on the fact that this CSV is downloaded if you simply follow the link I pasted in the URL field above.
Thanks!
@Test_Test For bulk update, append and clear, we have built a tool where we can save tons of operations.
Feel free to book a slot from Calendly if interested for a demo:
3 Likes
How are you getting these options? are they already gone?
Which options? Please let me know
