westernmeadow
|
2022abecc8
|
cleaned terminal output
|
1 year ago |
ericssonmarin-cpp
|
47c851ebeb
|
Db connection Markets and Forums.
|
1 year ago |
ericssonmarin-cpp
|
f375e0860f
|
Db connection.
|
1 year ago |
westernmeadow
|
99ad53022c
|
new prepare_parser.py logic
|
1 year ago |
chris
|
beb4745093
|
Added Robinhood Market crawler and parser
|
1 year ago |
westernmeadow
|
40fc1649de
|
Merge branch 'josh-dev' into 'main'
Finished HiddenMarket Crawler and Parser and fixed clean_html() bug
See merge request dw9372422/dw_pipeline_test!4
|
1 year ago |
Joshua
|
2bf3e7447e
|
Uncommented Commented things that shouldve been uncommented. also added item rating in listing parser.
|
1 year ago |
Joshua
|
be89dcfe30
|
Merge branch 'main' into josh-dev
# Conflicts:
# Forums/Utilities/utilities.py
# MarketPlaces/Initialization/geckodriver.log
# MarketPlaces/Initialization/marketsList.txt
# MarketPlaces/Initialization/markets_mining.py
# MarketPlaces/Initialization/prepare_parser.py
# MarketPlaces/Utilities/utilities.py
# setup.ini
|
1 year ago |
Joshua
|
0baf9ff36d
|
Finished Hiddenmarket Parser. Ran successful tests. Hiddenmarket complete
|
1 year ago |
Joshua
|
594e52949b
|
Working on Parser. Finished description parser.
|
1 year ago |
Joshua
|
2d561bec29
|
Finished crawler and fixed clean_html() so it still removes images but doesnt erase the whole line, just the link
|
1 year ago |
dabadcuber5
|
a2bb66165b
|
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test
|
1 year ago |
dabadcuber5
|
d90bf734d0
|
finished TorMarket
|
1 year ago |
Khoi
|
cac935733c
|
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test
|
1 year ago |
Khoi
|
6bf73f3f69
|
updated parser for hiddenanswers
|
1 year ago |
Khoi
|
89fb117115
|
fixed pagination issues with hiddenanswers crawler
|
1 year ago |
Helium
|
bcf6ed0b7b
|
completed lionmarketplace scraper
|
1 year ago |
Khoi
|
709ca196cc
|
Completed and tested parsers for Libre
|
1 year ago |
Khoi
|
6e1a1b6b2a
|
completed Libre forum (not tested yet)
|
1 year ago |
Khoi
|
115449492e
|
Completed and tested the parsers for DigitalThriftShop
|
1 year ago |
Khoi
|
ac80489d4a
|
fixed merge conflicts
|
1 year ago |
Khoi
|
cf6ee1c659
|
fixed local merge conlficts
|
1 year ago |
westernmeadow
|
811d1f6352
|
removed all __pycache__ directories
|
1 year ago |
Helium
|
d5ac12195d
|
darkmatter and m00key scraper verified
|
1 year ago |
Khoi
|
8ff65ece87
|
resolve merge conflicts
|
1 year ago |
Khoi
|
afbe8d0977
|
Completed and tested all parsers fro Cardingleaks forum
|
1 year ago |
Helium
|
ccf256762d
|
need to test DarkMatter scraper, tentatively finished
|
1 year ago |
Khoi
|
053bc28b54
|
Completed and tested all parsers for Altenens forum
|
1 year ago |
Joshua
|
a5a1f1b0cc
|
Fixed setup.ini
|
1 year ago |
Joshua
|
05a33c9c6c
|
Fixed setup.ini
|
1 year ago |
Joshua
|
4dcc9bf86c
|
First Commit. Added categories and started testing for crawler.
|
1 year ago |
westernmeadow
|
5045002a7b
|
Merge branch 'josh-development' into 'main'
Finished Crawler and Parser for ViceCIty
See merge request dw9372422/dw_pipeline_test!3
|
1 year ago |
westernmeadow
|
c4a9908cfe
|
Merge branch 'main' into 'josh-development'
# Conflicts:
# setup.ini
|
1 year ago |
Helium
|
af01d48276
|
m00nkey scraper completed
|
1 year ago |
Helium
|
280fe888d2
|
m00nkey scraper completed
|
1 year ago |
Helium
|
c3fc846dd6
|
parsers not finished, pushed to be fixed
|
1 year ago |
Joshua
|
60f15c7b13
|
Merge branch 'main' into josh-development
# Conflicts:
# MarketPlaces/Initialization/geckodriver.log
# MarketPlaces/Initialization/marketsList.txt
# MarketPlaces/Initialization/prepare_parser.py
# setup.ini
|
1 year ago |
Joshua
|
c50fe116c2
|
Completed and Tested Vicecity
|
1 year ago |
Khoi
|
4133f340cd
|
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test
|
1 year ago |
Khoi
|
a6bdb89850
|
Completed and tested all parsers for Procrax
|
1 year ago |
westernmeadow
|
2d5116968d
|
updated all marketplace crawlers
|
1 year ago |
Khoi
|
e066d3776a
|
resolved all merge conflicts
|
1 year ago |
Khoi
|
51f7920a49
|
Finished with parser for AnonymousMarketplace
|
1 year ago |
Helium
|
b3188f4716
|
updated all forum crawlers
|
1 year ago |
Joshua
|
abeb2c0df0
|
fixed bugs with crawler not getting all pages and parser breaking
|
1 year ago |
Helium
|
73e1aff5f3
|
fixed anonymous
|
1 year ago |
Helium
|
d0ed3511f4
|
finished torbay scraper
finished m00nkey description parser. need to work on m00nkey listing
|
1 year ago |
Joshua
|
bd5a05ffb4
|
finished crawler and parser
|
1 year ago |
Joshua
|
db93632843
|
updated utilities.py to fix bug with clean_html()
|
1 year ago |
westernmeadow
|
3a665039c6
|
finished altenens parser
changed naming scheme of multiple pages of topics
|
1 year ago |