home/scraper
2
0
Fork 0
mirror of https://github.com/wahyd4/scraper.git synced 2026-08-09 05:06:22 +10:00
Code Issues Packages Projects Releases Wiki Activity
31 Commits 1 Branch 0 Tags
771a68546c943a14fe9ff2f0d55ce7ccfd81065a
T
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
junv 771a68546c Only run every sunday 10 am
2020-05-07 16:03:54 +10:00
.github/workflows
rename
2020-05-07 15:57:27 +10:00
.vscode
be able to generate proper csv files
2020-02-24 23:38:15 +11:00
config
Add DB
2020-02-25 17:06:26 +11:00
csvs
Add function to record clearance rate into db
2020-03-06 12:02:29 +11:00
handlers
update information
2020-03-06 14:14:35 +11:00
model
Add function to record clearance rate into db
2020-03-06 12:02:29 +11:00
status
Refine the logic of checking date
2020-05-07 00:02:52 +10:00
utils
add ability to scrap multiple cities
2020-03-06 12:22:23 +11:00
.gitignore
Add dockerfile
2020-05-07 11:02:36 +10:00
Dockerfile
Add dockerfile
2020-05-07 11:02:36 +10:00
go.mod
Add function to record clearance rate into db
2020-03-06 12:02:29 +11:00
go.sum
Add function to record clearance rate into db
2020-03-06 12:02:29 +11:00
main.go
refine logic
2020-05-07 10:48:34 +10:00
manifest.yaml
Only run every sunday 10 am
2020-05-07 16:03:54 +10:00
README.md
Add building badges
2020-05-07 14:48:10 +10:00
result2.csv
be able to generate proper csv files
2020-02-24 23:38:15 +11:00

README.md

Domain Scraper

ci

Domain URL: https://www.domain.com.au/auction-results/melbourne/

https://github.com/gocolly/colly/blob/master/_examples/hackernews_comments/hackernews_comments.go

DB_USERNAME=xxx DB_PASSWORD=xxx PORT=xxxxx go run main.go
Reference in New Issue View Git Blame Copy Permalink
S
Description
No description provided
Readme
305 KiB
Languages
Go 97.3%
Dockerfile 2.7%