westernmeadow
|
d1767b560e
|
Merge branch '0day' into 'main'
0day
See merge request dw9372422/dw_pipeline_test!13
|
10 months ago |
Lokaranjan Munta
|
a00dd301b0
|
Merge branch 'main' into '0day'
# Conflicts:
# MarketPlaces/Initialization/markets_mining.py
# MarketPlaces/Initialization/prepare_parser.py
|
10 months ago |
Joshua
|
0bb689d06a
|
Merge remote-tracking branch 'origin/main'
|
10 months ago |
Joshua
|
e0e32e68b8
|
josh's progress on torzon market
|
10 months ago |
Kimtaiyo Mech
|
fa8cb71d37
|
minor naming fix and used cleanString and cleanNumbers
|
11 months ago |
loki1001
|
2ba47f0ac8
|
fixed naming of initial 0days parser
|
11 months ago |
loki1001
|
5bf8b76c6c
|
Merge branch '0day' of https://gitlab.com/dw9372422/dw_pipeline_test into 0day
# Conflicts:
# MarketPlaces/ZeroDay/parser.py
|
11 months ago |
loki1001
|
c42d89662f
|
fixed naming of initial 0days parser
|
11 months ago |
loki1001
|
13eb2aac9d
|
initial 0days parser
|
11 months ago |
Kimtaiyo Mech
|
e39dd18090
|
initial crawler for ZeroDay
|
11 months ago |
rida
|
09886c99d4
|
Merge remote-tracking branch 'origin/main'
|
11 months ago |
Helium
|
ab80441306
|
completed darkbay marketplace scraper
|
11 months ago |
Helium
|
dcc07f5d2b
|
completed GoFish
|
11 months ago |
Helium
|
7b552c8d70
|
Merge remote-tracking branch 'origin/main'
|
11 months ago |
Helium
|
74b13dd532
|
completed NemesisMarket scraper
untested NemesisForums crawler
i am unable to run anything related to forums
|
11 months ago |
westernmeadow
|
5c25855ce6
|
Merge remote-tracking branch 'origin/main'
|
11 months ago |
westernmeadow
|
1d1d2e8e96
|
finished WeTheNorth and MikesGrandStore
|
11 months ago |
Helium
|
b271fe0d2c
|
Merge remote-tracking branch 'origin/main'
|
11 months ago |
Helium
|
a477b0a8ec
|
added sleep for 5 seconds
|
11 months ago |
Helium
|
4cacfeebd9
|
crawler fixed for kerberos, but not checked.
|
11 months ago |
westernmeadow
|
69c9ee3689
|
fixes to Incogsnoo
|
11 months ago |
westernmeadow
|
834f34f1e7
|
fixes to CypherMarketplace parser
|
11 months ago |
westernmeadow
|
7b108f7ddc
|
increased character length limit of table columns
|
1 year ago |
rida
|
eacf94a0df
|
added crawler and parser for Endchan, didn't quite understand connecting to database.
|
1 year ago |
westernmeadow
|
7687fc283c
|
fixes to image tables
|
1 year ago |
westernmeadow
|
2c44cb6402
|
added image table to forums
|
1 year ago |
westernmeadow
|
4b172d2351
|
added image table to markets
|
1 year ago |
westernmeadow
|
5836e26e37
|
changed href_item/topic to primary key and added vendor/author, name/title, and classification to tracked change
|
1 year ago |
westernmeadow
|
85acaf41ad
|
reverted commits af32a2797b and 5de337ae74
|
1 year ago |
westernmeadow
|
bcef4631b0
|
Merge branch 'gofish' into 'main'
Gofish
See merge request dw9372422/dw_pipeline_test!12
|
1 year ago |
Joshua
|
e6e8c594b5
|
uncommented gofish crawler
|
1 year ago |
Joshua
|
ac1eb6da97
|
fixed Gofish parser
|
1 year ago |
Joshua
|
bff8156764
|
Merge branch 'main' into gofish_dev
# Conflicts:
# MarketPlaces/Initialization/marketsList.txt
# MarketPlaces/Initialization/markets_mining.py
# MarketPlaces/Initialization/prepare_parser.py
|
1 year ago |
westernmeadow
|
b9a8ab1647
|
added missing comma
|
1 year ago |
Joshua
|
77565cfa22
|
gofish parser done. now testing
|
1 year ago |
Anita Mehr
|
5c9af8655c
|
pushing parser for WeTheNorth, for initial review
|
1 year ago |
Anita Mehr
|
13a813e9b9
|
finished crawler for WeTheNorth marketplace.
|
1 year ago |
Anita Mehr
|
598e3398cb
|
first try.
|
1 year ago |
Khoi
|
d438192fea
|
Finish Crawler & Parser for TheDarkMarket
|
1 year ago |
Khoi
|
ca2e8aedfd
|
Finish Crawler & Parser for TheDarkMarket
|
1 year ago |
Joshua
|
48b3fee56a
|
finished crawler for GoFish
|
1 year ago |
chris
|
40e9bc10cf
|
Finished Crawler and Parser for MikesGrandStore
|
1 year ago |
westernmeadow
|
7dec52fb02
|
small edits to CypherMarketplace
|
1 year ago |
westernmeadow
|
2ec850869c
|
completed BlackPyramid and CityMarket
|
1 year ago |
westernmeadow
|
dadd57145c
|
Merge branch 'incogsnoo' into 'main'
added Incogsnoo crawler and parser
See merge request dw9372422/dw_pipeline_test!11
|
1 year ago |
Kimtaiyo Mech
|
d6be3bf58d
|
added Incogsnoo crawler and parser
|
1 year ago |
Joshua
|
1a2d29d94f
|
setup configs for gofish crawling and parsing
|
1 year ago |
Nathan Pham
|
cfcff093e4
|
finish cyphermarketplace
|
1 year ago |
Nathan Pham
|
f2ae29d28a
|
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test
|
1 year ago |
andymunoz92
|
6a179bad09
|
Merge remote-tracking branch 'origin/main'
|
1 year ago |