2188 Commits
Author SHA1 Message Date
Marvin Zhang ab2279c647 added github import 2019-03-04 12:07:14 +08:00
Marvin Zhang fd1d4f3839 added License 2019-03-03 11:00:50 +08:00
Marvin Zhang 5d9bf710d6 added License 2019-03-03 10:58:47 +08:00
Marvin Zhang 25ee4b8d22 updated setup.py 2019-03-03 10:57:19 +08:00
Marvin Zhang c16c6f49eb Merge remote-tracking branch 'origin/master' 2019-03-03 10:48:19 +08:00
Marvin Zhang 8361c04de9 added setup.py 2019-03-03 10:48:04 +08:00
Marvin ZhangandGitHub 23fb1b86dc Delete LICENSE 2019-03-03 10:44:42 +08:00
Marvin Zhang d26f43e09e updated README.md 2019-03-02 10:07:05 +08:00
Marvin Zhang 307a1872f1 fixed deploy/run task issue 2019-03-02 09:37:55 +08:00
Marvin Zhang f3ff0a464a updated execute spider logic 2019-03-01 12:07:28 +08:00
Marvin Zhang d8766f2a97 updated Dockerfile 2019-03-01 11:45:32 +08:00
Marvin Zhang 007752ce3a updated Dockerfile 2019-02-28 18:57:44 +08:00
Marvin Zhang be887cef22 prepare for multi-node deployment 2019-02-26 13:00:06 +08:00
Marvin Zhang 8b8db8e94e updated requirements.txt 2019-02-26 12:42:12 +08:00
Marvin Zhang 318e5876a6 fixed sorting issue 2019-02-25 19:32:43 +08:00
Marvin Zhang dc9f27e720 updated home page 2019-02-25 13:18:26 +08:00
Marvin Zhang 55733a7b8c added pagination 2019-02-23 21:40:26 +08:00
Marvin Zhang 278d6e72f5 added TaskOverview 2019-02-23 18:39:22 +08:00
Marvin Zhang c7cf064c21 updated TODO 2019-02-21 17:00:35 +08:00
Marvin Zhang 99c538f972 updated spider/node overviews 2019-02-21 16:52:50 +08:00
Marvin Zhang 4e6e2e76de return existing nodes 2019-02-21 14:18:26 +08:00
Marvin Zhang 913c0644c9 updated node/spider overviews 2019-02-21 14:08:48 +08:00
Marvin Zhang 5eb69a4b0d overview pages updated 2019-02-20 21:24:28 +08:00
Marvin Zhang 6b13975af4 added log file for task 2019-02-19 22:55:52 +08:00
Marvin Zhang a4a0fdd67b added tasks 2019-02-18 21:16:40 +08:00
Marvin Zhang 06575c8ae5 update deploy and crawl functionality 2019-02-18 13:27:57 +08:00
Marvin Zhang 21ac8e9894 finalize file management 2019-02-17 22:30:52 +08:00
Marvin Zhang 714ccd18aa update SpiderDetail 2019-02-17 11:14:22 +08:00
Marvin Zhang 2cca685a71 adapt changes for SpiderList and NodeList 2019-02-16 22:56:58 +08:00
Yeqing Zhang 7d160d8665 update routes 2019-02-15 12:33:19 +08:00
Yeqing Zhang bbeb5ca5b5 added deploys 2019-02-13 20:53:15 +08:00
Yeqing Zhang 55b2d5064f optimized api base 2019-02-13 13:08:35 +08:00
Yeqing Zhang 4f2a29bd42 added models 2019-02-12 13:08:04 +08:00
Marvin ZhangandYeqing Zhang 9f84e2fad1 added base class for api handling 2019-02-12 07:00:19 +08:00
Yeqing Zhang 04c5d69c9f added base class for api handling 2019-02-12 06:58:54 +08:00
Marvin Zhang 2610f76719 task CRUD update 2019-02-11 22:29:35 +08:00
Marvin Zhang 7e8531aa57 added celery functionality
added CRUD base
2019-02-11 13:25:33 +08:00
Yeqing ZhangandGitHub 426fb19238 Initial commit 2019-02-10 14:02:00 +08:00