Commit Graph
-
9cc1b6c(HEAD -> main) Update 2 files by 2024-08-04 11:56:23 +0000 -
1c8f7c7DarkRoad Parser by 2024-08-04 11:10:11 +0000 -
a6ae37bDarkRoad Crawler by 2024-08-04 11:09:26 +0000 -
819787dCompleted DarkRoad crawler and parser by 2024-08-04 11:08:48 +0000 -
93803e7Updated by 2024-07-10 16:33:00 -0700 -
0629542Updated the imports by 2024-07-10 16:31:08 -0700 -
b8ad23eMerge remote-tracking branch 'origin/main' by 2024-07-10 16:14:57 -0700 -
dc4ca1dAdded SilkRoad4 Parser and Crawler by 2024-07-10 16:06:41 -0700 -
c1c4b0fDark Market Crawler and Parser by 2024-07-10 16:05:46 -0700 -
02adf82Dark Market Crawler and Parser by 2024-07-10 16:01:16 -0700 -
381e8beedits to DarkDock crawler by 2024-07-08 15:03:12 -0700 -
07e71ecmoved Vortex back to test by 2024-07-08 01:26:36 -0700 -
b9fe3deMerge branch 'bri-matt-dev' into 'main' by 2024-07-08 02:23:37 +0000 -
438ef42Added DarkDock Marketplace Parser and Crawler by 2024-07-08 02:23:37 +0000 -
98c8c8cMerge remote-tracking branch 'origin/main' by 2024-06-24 16:42:43 -0700 -
1918cddDark Market Crawler and Parser by 2024-06-24 16:41:32 -0700 -
79e28e9Dark Market Crawler and Parser by 2024-06-24 16:36:20 -0700 -
0bbaefbDark Market Crawler and Parser by 2024-06-24 16:33:46 -0700 -
ac7cc85Added incomplete parser for abacus manually by 2024-06-05 03:10:31 +0000 -
f0f6753added incomplete abacus crawler manually by 2024-06-05 03:09:43 +0000 -
3f41f19Add new directory manually by 2024-06-05 03:08:44 +0000 -
c996543Added incomplete MGM crawler manually due to issues with vm by 2024-06-05 03:07:38 +0000 -
f915cd0Added incomplete MGM parser manually due to issues with my vm and git by 2024-06-05 03:06:33 +0000 -
c4f3bfdAdd new directory from gitlab addition, problems with my vm by 2024-06-05 03:05:03 +0000 -
bce3df6init nexus market crawler and parser by 2024-05-31 17:40:45 -0700 -
8b0993dcompleted atlas marketplace by 2024-05-31 11:47:02 -0700 -
00792f6completed vortex marketplace by 2024-05-29 12:05:06 -0700 -
1808a03darknetarmy scraper completed by 2024-05-24 12:04:39 -0700 -
8e922ectranslating topic title fix by 2024-05-24 06:52:24 +0000 -
17d5e9fskip translate when source equals target by 2024-04-25 23:28:38 +0000 -
79cb099integrated translator to prepare_parser.py by 2024-04-18 17:06:55 -0700 -
d1767b5Merge branch '0day' into 'main' by 2024-04-03 22:20:35 +0000 -
a00dd30Merge branch 'main' into '0day' by 2024-04-03 03:08:40 +0000 -
0bb689dMerge remote-tracking branch 'origin/main' by 2024-03-13 11:59:03 -0700 -
e0e32e6josh's progress on torzon market by 2024-03-13 11:58:29 -0700 -
fa8cb71minor naming fix and used cleanString and cleanNumbers by 2024-02-27 12:31:41 -0800 -
2ba47f0fixed naming of initial 0days parser by 2024-02-26 22:49:18 -0800 -
5bf8b76Merge branch '0day' of https://gitlab.com/dw9372422/dw_pipeline_test into 0day by 2024-02-26 22:48:52 -0800 -
c42d896fixed naming of initial 0days parser by 2024-02-26 03:10:46 -0800 -
13eb2aainitial 0days parser by 2024-02-26 03:10:46 -0800 -
e39dd18initial crawler for ZeroDay by 2024-02-25 16:39:52 -0800 -
09886c9Merge remote-tracking branch 'origin/main' by 2024-02-20 14:29:04 -0800 -
ab80441completed darkbay marketplace scraper by 2024-02-14 21:46:19 -0800 -
dcc07f5completed GoFish by 2024-02-12 13:18:20 -0800 -
7b552c8Merge remote-tracking branch 'origin/main' by 2024-02-08 13:57:44 -0800 -
74b13ddcompleted NemesisMarket scraper untested NemesisForums crawler i am unable to run anything related to forums by 2024-02-08 13:57:16 -0800 -
5c25855Merge remote-tracking branch 'origin/main' by 2024-02-08 12:29:07 -0800 -
1d1d2e8finished WeTheNorth and MikesGrandStore by 2024-02-08 12:28:11 -0800 -
b271fe0Merge remote-tracking branch 'origin/main' by 2024-02-07 19:55:00 -0800 -
a477b0aadded sleep for 5 seconds by 2024-02-07 19:54:47 -0800 -
4cacfeecrawler fixed for kerberos, but not checked. by 2024-02-07 13:00:36 -0800 -
69c9ee3fixes to Incogsnoo by 2024-02-06 16:59:34 -0800 -
834f34ffixes to CypherMarketplace parser by 2024-02-06 16:40:42 -0800 -
7b108f7increased character length limit of table columns by 2024-02-04 23:31:50 +0000 -
eacf94aadded crawler and parser for Endchan, didn't quite understand connecting to database. by 2024-01-16 03:28:00 -0800 -
7687fc2fixes to image tables by 2024-01-02 23:13:45 -0800 -
2c44cb6added image table to forums by 2024-01-01 03:18:55 +0000 -
4b172d2added image table to markets by 2023-12-31 23:38:25 +0000 -
5836e26changed href_item/topic to primary key and added vendor/author, name/title, and classification to tracked change by 2023-12-23 21:48:56 -0800 -
85acaf4reverted commitsaf32a2797band5de337ae74by 2023-12-23 19:04:37 -0800 -
bcef463Merge branch 'gofish' into 'main' by 2023-12-11 22:47:42 +0000 -
e6e8c59uncommented gofish crawler by 2023-12-06 16:53:33 -0800 -
ac1eb6dfixed Gofish parser by 2023-12-06 16:51:49 -0800 -
bff8156Merge branch 'main' into gofish_dev by 2023-12-05 13:41:23 -0800 -
b9a8ab1added missing comma by 2023-12-05 21:38:33 +0000 -
77565cfgofish parser done. now testing by 2023-12-05 13:21:22 -0800 -
5c9af86pushing parser for WeTheNorth, for initial review by 2023-12-02 23:19:07 +0000 -
13a813efinished crawler for WeTheNorth marketplace. by 2023-12-02 22:24:39 +0000 -
598e339first try. by 2023-12-02 22:20:44 +0000 -
d438192Finish Crawler & Parser for TheDarkMarket by 2023-11-28 20:14:01 -0800 -
ca2e8aeFinish Crawler & Parser for TheDarkMarket by 2023-11-28 20:10:05 -0800 -
48b3feefinished crawler for GoFish by 2023-11-27 18:19:49 -0800 -
40e9bc1Finished Crawler and Parser for MikesGrandStore by 2023-11-26 10:23:29 -0800 -
7dec52fsmall edits to CypherMarketplace by 2023-11-18 22:28:04 -0800 -
2ec8508completed BlackPyramid and CityMarket by 2023-11-18 22:08:15 -0800 -
dadd571Merge branch 'incogsnoo' into 'main' by 2023-11-17 01:03:21 +0000 -
d6be3bfadded Incogsnoo crawler and parser by 2023-11-16 16:22:05 -0800 -
1a2d29dsetup configs for gofish crawling and parsing by 2023-11-13 08:47:20 -0800 -
cfcff09finish cyphermarketplace by 2023-11-12 00:12:28 -0800 -
f2ae29dMerge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test by 2023-11-11 20:21:45 -0800 -
6a179baMerge remote-tracking branch 'origin/main' by 2023-11-10 18:38:28 -0800 -
735f4cfCrawler & Parser for CityMarket. utilities.py was modified to work with CityMarket. by 2023-11-10 18:37:18 -0800 -
bd979cacompleted Kingdom, Quest, Ares, and Sonanza by 2023-11-08 16:02:26 -0800 -
9e21f6bBring parser up to date and improved crawler by 2023-11-05 18:35:34 -0800 -
e22faceBestCarding + DbConnection Create Tables. by 2023-11-03 16:25:39 -0700 -
54fddc3BestCarding + DbConnection Create Tables. by 2023-11-03 16:22:25 -0700 -
6117dc0Merge branch 'ares_dev' into 'main' by 2023-11-02 00:05:48 +0000 -
e24b516Merge branch 'main' into ares_dev by 2023-11-01 16:06:17 -0700 -
72da7f2finished crawler and parser by 2023-11-01 15:58:39 -0700 -
bbe020crefactored BlackPyramid by 2023-10-31 15:56:12 -0700 -
1b2047ffinished listing parser by 2023-10-31 09:15:26 -0700 -
9d1448bremoved print statement by 2023-10-30 17:09:27 -0700 -
77e401bMerge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test by 2023-10-30 17:06:35 -0700 -
3c42d28Finished crawler and parser for Quest maketplace by 2023-10-30 17:04:48 -0700 -
2e34fe2Cleaned up some test comments in crawler and parser by 2023-10-30 00:33:48 -0700 -
746ec6dAdded crawler and parser for Black Pyramid Marketplace by 2023-10-30 00:31:19 -0700 -
15aa400Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test by 2023-10-28 18:39:09 -0700 -
c976032small fixes by 2023-10-27 15:35:31 -0700 -
acb2d2bMerge remote-tracking branch 'origin/main' by 2023-10-27 15:14:18 -0700 -
b084d76listings, descriptions, and reference date by 2023-10-27 15:13:58 -0700