westernmeadow
|
803f4b47a2
|
debugged LionMarketplace, Nexus, and RobinhoodMarket
|
1 year ago |
ericssonmarin-cpp
|
e9a3dc9bac
|
Image tracking.
|
1 year ago |
ericssonmarin-cpp
|
19e8513dc4
|
Images tracking.
|
1 year ago |
westernmeadow
|
aac0b87f14
|
image debug for marketplaces
|
1 year ago |
westernmeadow
|
cca45ad92f
|
removed opentor() from all crawlers and set permissions.default.image to 3
|
1 year ago |
ericssonmarin-cpp
|
5a3725d949
|
Merge remote-tracking branch 'origin/main'
# Conflicts:
# MarketPlaces/DB_Connection/db_connection.py
|
1 year ago |
ericssonmarin-cpp
|
9207c4f30d
|
Images.
|
1 year ago |
westernmeadow
|
fb1de6b03c
|
Merge remote-tracking branch 'origin/main'
|
1 year ago |
westernmeadow
|
baa6974be7
|
debugged forums
|
1 year ago |
nathanvpham
|
13ab03349d
|
Merge branch 'PEparsers' into 'main'
finished PabloEscobarMarket parser
See merge request dw9372422/dw_pipeline_test!6
|
1 year ago |
Nathan Pham
|
4856d79540
|
finished PabloEscobarMarket parser
|
1 year ago |
nathanvpham
|
350e7651c1
|
Merge branch 'nathan-dev' into 'main'
add metaverse market and pabloescobar market
See merge request dw9372422/dw_pipeline_test!5
|
1 year ago |
Nathan Pham
|
12c5c356f0
|
add metaverse market and pabloescobar market
|
1 year ago |
Nathan Pham
|
493731a10c
|
changed forum function names to MKT
|
1 year ago |
westernmeadow
|
ff864f0dd3
|
fixed parsing vendor rating for ThiefWorld
|
1 year ago |
westernmeadow
|
9fe1072b3a
|
update marketsList.txt with completed markets
|
1 year ago |
westernmeadow
|
d5c78b3e3f
|
debugged marketplaces
|
1 year ago |
Nathan Pham
|
2731a8cabd
|
add DarkBazar
|
1 year ago |
westernmeadow
|
1a1e887d35
|
added new prepare_parser.py and cleaned output for marketplaces
|
1 year ago |
unknown
|
4f6126aedb
|
Added Nexus to the mining and parser logic
|
1 year ago |
unknown
|
212077dc5c
|
Nexus Crawler & Parser completed
|
1 year ago |
westernmeadow
|
371d077c24
|
fixed circular import
|
1 year ago |
westernmeadow
|
dde9f499be
|
added image aes encryption, base64 encoding, and html embedding to MarketPlaces
|
1 year ago |
westernmeadow
|
d1943e5586
|
added image aes encryption, base64 encoding, and html embedding
|
1 year ago |
ericssonmarin-cpp
|
97d9251ba4
|
Db connection for Markets.
|
1 year ago |
ericssonmarin-cpp
|
f0ec709c29
|
Merge remote-tracking branch 'origin/main'
|
1 year ago |
ericssonmarin-cpp
|
ff071d8b8f
|
Db connection for Markets.
|
1 year ago |
westernmeadow
|
2022abecc8
|
cleaned terminal output
|
1 year ago |
ericssonmarin-cpp
|
47c851ebeb
|
Db connection Markets and Forums.
|
1 year ago |
ericssonmarin-cpp
|
f375e0860f
|
Db connection.
|
1 year ago |
westernmeadow
|
99ad53022c
|
new prepare_parser.py logic
|
1 year ago |
chris
|
beb4745093
|
Added Robinhood Market crawler and parser
|
1 year ago |
westernmeadow
|
40fc1649de
|
Merge branch 'josh-dev' into 'main'
Finished HiddenMarket Crawler and Parser and fixed clean_html() bug
See merge request dw9372422/dw_pipeline_test!4
|
1 year ago |
Joshua
|
2bf3e7447e
|
Uncommented Commented things that shouldve been uncommented. also added item rating in listing parser.
|
1 year ago |
Joshua
|
be89dcfe30
|
Merge branch 'main' into josh-dev
# Conflicts:
# Forums/Utilities/utilities.py
# MarketPlaces/Initialization/geckodriver.log
# MarketPlaces/Initialization/marketsList.txt
# MarketPlaces/Initialization/markets_mining.py
# MarketPlaces/Initialization/prepare_parser.py
# MarketPlaces/Utilities/utilities.py
# setup.ini
|
1 year ago |
Joshua
|
0baf9ff36d
|
Finished Hiddenmarket Parser. Ran successful tests. Hiddenmarket complete
|
1 year ago |
Joshua
|
594e52949b
|
Working on Parser. Finished description parser.
|
1 year ago |
Joshua
|
2d561bec29
|
Finished crawler and fixed clean_html() so it still removes images but doesnt erase the whole line, just the link
|
1 year ago |
dabadcuber5
|
a2bb66165b
|
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test
|
1 year ago |
dabadcuber5
|
d90bf734d0
|
finished TorMarket
|
1 year ago |
Khoi
|
cac935733c
|
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test
|
1 year ago |
Khoi
|
6bf73f3f69
|
updated parser for hiddenanswers
|
1 year ago |
Khoi
|
89fb117115
|
fixed pagination issues with hiddenanswers crawler
|
1 year ago |
Helium
|
bcf6ed0b7b
|
completed lionmarketplace scraper
|
1 year ago |
Khoi
|
709ca196cc
|
Completed and tested parsers for Libre
|
1 year ago |
Khoi
|
6e1a1b6b2a
|
completed Libre forum (not tested yet)
|
1 year ago |
Khoi
|
115449492e
|
Completed and tested the parsers for DigitalThriftShop
|
1 year ago |
Khoi
|
ac80489d4a
|
fixed merge conflicts
|
1 year ago |
Khoi
|
cf6ee1c659
|
fixed local merge conlficts
|
1 year ago |
westernmeadow
|
811d1f6352
|
removed all __pycache__ directories
|
1 year ago |