home/scraper

Fork 0

mirror of https://github.com/wahyd4/scraper.git synced 2026-08-09 05:06:22 +10:00

T

junv f2c1e61c7a update check date

2022-04-12 09:31:13 +10:00

.github/workflows

Use ubuntu to build scraper

2022-04-07 11:53:45 +10:00

.vscode

be able to generate proper csv files

2020-02-24 23:38:15 +11:00

config

Add DB

2020-02-25 17:06:26 +11:00

csvs

Add function to record clearance rate into db

2020-03-06 12:02:29 +11:00

handlers

Update scraper

2022-04-07 11:39:05 +10:00

model

Add function to record clearance rate into db

2020-03-06 12:02:29 +11:00

status

- Fix the auction date null issue

2020-06-14 09:55:00 +10:00

utils

add ability to scrap multiple cities

2020-03-06 12:22:23 +11:00

.gitignore

Add dockerfile

2020-05-07 11:02:36 +10:00

Dockerfile

Add dockerfile

2020-05-07 11:02:36 +10:00

go.mod

Update scraper

2022-04-07 11:39:05 +10:00

go.sum

Update scraper

2022-04-07 11:39:05 +10:00

main.go

update check date

2022-04-12 09:31:13 +10:00

manifest-template.yaml

Update template

2022-04-10 08:58:10 +10:00

manifest.yaml

Update manifest

2022-04-09 22:59:15 +00:00

README.md

Add building badges

2020-05-07 14:48:10 +10:00

result2.csv

be able to generate proper csv files

2020-02-24 23:38:15 +11:00

README.md

Domain Scraper

Domain URL: https://www.domain.com.au/auction-results/melbourne/

https://github.com/gocolly/colly/blob/master/_examples/hackernews_comments/hackernews_comments.go

DB_USERNAME=xxx DB_PASSWORD=xxx PORT=xxxxx go run main.go