Nathan Pham
|
2731a8cabd
|
add DarkBazar
|
1 year ago |
westernmeadow
|
1a1e887d35
|
added new prepare_parser.py and cleaned output for marketplaces
|
1 year ago |
unknown
|
4f6126aedb
|
Added Nexus to the mining and parser logic
|
1 year ago |
unknown
|
212077dc5c
|
Nexus Crawler & Parser completed
|
1 year ago |
westernmeadow
|
371d077c24
|
fixed circular import
|
1 year ago |
westernmeadow
|
dde9f499be
|
added image aes encryption, base64 encoding, and html embedding to MarketPlaces
|
1 year ago |
westernmeadow
|
d1943e5586
|
added image aes encryption, base64 encoding, and html embedding
|
1 year ago |
ericssonmarin-cpp
|
97d9251ba4
|
Db connection for Markets.
|
1 year ago |
ericssonmarin-cpp
|
f0ec709c29
|
Merge remote-tracking branch 'origin/main'
|
1 year ago |
ericssonmarin-cpp
|
ff071d8b8f
|
Db connection for Markets.
|
1 year ago |
westernmeadow
|
2022abecc8
|
cleaned terminal output
|
1 year ago |
ericssonmarin-cpp
|
47c851ebeb
|
Db connection Markets and Forums.
|
1 year ago |
ericssonmarin-cpp
|
f375e0860f
|
Db connection.
|
1 year ago |
westernmeadow
|
99ad53022c
|
new prepare_parser.py logic
|
1 year ago |
chris
|
beb4745093
|
Added Robinhood Market crawler and parser
|
1 year ago |
westernmeadow
|
40fc1649de
|
Merge branch 'josh-dev' into 'main'
Finished HiddenMarket Crawler and Parser and fixed clean_html() bug
See merge request dw9372422/dw_pipeline_test!4
|
1 year ago |
Joshua
|
2bf3e7447e
|
Uncommented Commented things that shouldve been uncommented. also added item rating in listing parser.
|
1 year ago |
Joshua
|
be89dcfe30
|
Merge branch 'main' into josh-dev
# Conflicts:
# Forums/Utilities/utilities.py
# MarketPlaces/Initialization/geckodriver.log
# MarketPlaces/Initialization/marketsList.txt
# MarketPlaces/Initialization/markets_mining.py
# MarketPlaces/Initialization/prepare_parser.py
# MarketPlaces/Utilities/utilities.py
# setup.ini
|
1 year ago |
Joshua
|
0baf9ff36d
|
Finished Hiddenmarket Parser. Ran successful tests. Hiddenmarket complete
|
1 year ago |
Joshua
|
594e52949b
|
Working on Parser. Finished description parser.
|
1 year ago |
Joshua
|
2d561bec29
|
Finished crawler and fixed clean_html() so it still removes images but doesnt erase the whole line, just the link
|
1 year ago |
dabadcuber5
|
a2bb66165b
|
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test
|
1 year ago |
dabadcuber5
|
d90bf734d0
|
finished TorMarket
|
1 year ago |
Khoi
|
cac935733c
|
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test
|
1 year ago |
Khoi
|
6bf73f3f69
|
updated parser for hiddenanswers
|
1 year ago |
Khoi
|
89fb117115
|
fixed pagination issues with hiddenanswers crawler
|
1 year ago |
Helium
|
bcf6ed0b7b
|
completed lionmarketplace scraper
|
1 year ago |
Khoi
|
709ca196cc
|
Completed and tested parsers for Libre
|
1 year ago |
Khoi
|
6e1a1b6b2a
|
completed Libre forum (not tested yet)
|
1 year ago |
Khoi
|
115449492e
|
Completed and tested the parsers for DigitalThriftShop
|
1 year ago |
Khoi
|
ac80489d4a
|
fixed merge conflicts
|
1 year ago |
Khoi
|
cf6ee1c659
|
fixed local merge conlficts
|
1 year ago |
westernmeadow
|
811d1f6352
|
removed all __pycache__ directories
|
1 year ago |
Helium
|
d5ac12195d
|
darkmatter and m00key scraper verified
|
1 year ago |
Khoi
|
8ff65ece87
|
resolve merge conflicts
|
1 year ago |
Khoi
|
afbe8d0977
|
Completed and tested all parsers fro Cardingleaks forum
|
1 year ago |
Helium
|
ccf256762d
|
need to test DarkMatter scraper, tentatively finished
|
1 year ago |
Khoi
|
053bc28b54
|
Completed and tested all parsers for Altenens forum
|
1 year ago |
Joshua
|
a5a1f1b0cc
|
Fixed setup.ini
|
1 year ago |
Joshua
|
05a33c9c6c
|
Fixed setup.ini
|
1 year ago |
Joshua
|
4dcc9bf86c
|
First Commit. Added categories and started testing for crawler.
|
1 year ago |
westernmeadow
|
5045002a7b
|
Merge branch 'josh-development' into 'main'
Finished Crawler and Parser for ViceCIty
See merge request dw9372422/dw_pipeline_test!3
|
1 year ago |
westernmeadow
|
c4a9908cfe
|
Merge branch 'main' into 'josh-development'
# Conflicts:
# setup.ini
|
1 year ago |
Helium
|
af01d48276
|
m00nkey scraper completed
|
1 year ago |
Helium
|
280fe888d2
|
m00nkey scraper completed
|
1 year ago |
Helium
|
c3fc846dd6
|
parsers not finished, pushed to be fixed
|
1 year ago |
Joshua
|
60f15c7b13
|
Merge branch 'main' into josh-development
# Conflicts:
# MarketPlaces/Initialization/geckodriver.log
# MarketPlaces/Initialization/marketsList.txt
# MarketPlaces/Initialization/prepare_parser.py
# setup.ini
|
1 year ago |
Joshua
|
c50fe116c2
|
Completed and Tested Vicecity
|
1 year ago |
Khoi
|
4133f340cd
|
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test
|
1 year ago |
Khoi
|
a6bdb89850
|
Completed and tested all parsers for Procrax
|
1 year ago |