1d091b9
removed indent by
2023-10-27 14:34:07 -0700
582449c
Merge remote-tracking branch 'origin/main' by
2023-10-26 16:39:27 -0700
f0003d4
kingdom completed for initial testing, might need to create new account every once in a while. the og account was deleted by
2023-10-26 13:14:25 -0700
0a9d4c5
finished crawler by
2023-10-26 08:34:52 -0700
88b31a4
updated market links by
2023-10-25 19:30:16 -0700
07bfc88
don't use cleanLink by
2023-10-25 16:30:57 -0700
59c5de6
Update login function by
2023-10-22 02:01:00 -0700
fc65c90
Add interested links list by
2023-10-22 01:35:07 -0700
61c85e0
Forums and Markets status. by
2023-10-15 15:38:24 -0700
ed5a919
Forums and Markets status. by
2023-10-15 15:20:02 -0700
44561c5
Revert "Forums and Markets status." by
2023-10-15 22:12:17 +0000
9fca859
Forums and Markets status. by
2023-10-15 14:00:28 -0700
74ac3c1
setup configs for ares crawler and added relevant ares links by
2023-10-09 16:48:00 -0700
47fdc73
resolve all merge conflicts by
2023-10-04 16:24:02 -0700
9a64698
last change before REU ended by
2023-10-04 16:21:56 -0700
a567086
added forum and market templates by
2023-10-03 15:53:04 -0700
7e2d5ee
deleted old file by
2023-09-29 08:07:19 +0000
5a4f55a
moved finished websites from test to production and unfinished websites from production to test by
2023-09-26 16:40:13 -0700
ec6530b
forum crawler logic updates by
2023-09-26 15:48:51 -0700
41f3735
finished fully running completed Altenens and Cardingleaks by
2023-09-20 23:27:35 -0700
a3ebc92
finished fully running completed AbyssForum and Procrax by
2023-09-20 23:25:39 -0700
414dc91
finished fully running completed OnniForums by
2023-09-19 23:33:16 -0700
309e08b
Merge remote-tracking branch 'origin/main' by
2023-09-18 17:22:16 -0700
d413f48
finished fully running completed Libre by
2023-09-18 17:14:16 -0700
c0b3bb1
Merge remote-tracking branch 'origin/main' by
2023-09-18 16:46:41 -0700
ce00b92
added delay after closing file in read_file() by
2023-09-18 16:46:01 -0700
a5c6122
quick fixes by
2023-09-18 16:33:08 -0700
2a9dbdc
updated decryption for forums utilities.py by
2023-09-18 11:49:44 -0700
92b2af5
Markets transactions. by
2023-09-17 19:26:19 -0700
07e320a
Merge remote-tracking branch 'origin/main' by
2023-09-17 19:20:54 -0700
7fc7690
Image tracking. by
2023-09-17 19:16:44 -0700
2dc18e2
finished fully running completed CryptBB and HiddenAnswers by
2023-09-17 19:14:42 -0700
58eede1
finished lock tables. by
2023-09-14 01:52:57 -0700
e12abc1
finished fully running completed markets by
2023-09-13 16:49:57 -0700
cfa4a1c
Image tracking. by
2023-09-13 14:18:48 -0700
0695609
image tracking edits for forums by
2023-09-11 14:49:23 -0700
d15e38f
Image tracking and version for forums. by
2023-09-11 12:57:30 -0700
0844b12
fully ran Apocalypse and DarkBazar, fixed move bug by
2023-09-08 15:50:09 -0700
32c57a8
Merge remote-tracking branch 'origin/main' by
2023-09-08 11:55:41 -0700
c6589f4
Image tracking and version. by
2023-09-08 11:51:54 -0700
344c654
added iframe tag to cleanHTML in utilities.py by
2023-09-07 17:42:01 -0700
eb85eeb
added Nulled forum and Kerberos market (both unfinished) by
2023-09-07 16:30:41 -0700
0345836
user image tracking ONLY (missing post image) for some forums by
2023-09-05 17:59:33 -0700
f86f4cc
Merge branch 'van-deliverable' into 'main' by
2023-09-05 21:48:19 +0000
d1d53d9
fixed change tracking bug and image tracking for AnonMarket by
2023-09-04 22:39:11 -0700
8968472
debugged ThiefWorld, TorMarket, and AnonMarket by
2023-09-01 14:25:26 -0700
3e2ac88
Merge remote-tracking branch 'origin/main' by
2023-09-01 13:29:32 -0700
e07b3cd
Image tracking. by
2023-09-01 13:25:15 -0700
2e8bc85
Merge branch 'MVMparser' into 'main' by
2023-09-01 10:28:19 +0000
0de7cf5
add parser by
2023-09-01 03:27:21 -0700
8de842b
Merge branch 'CMparser' into 'main' by
2023-09-01 06:42:10 +0000
801878b
completed parser by
2023-08-31 23:39:36 -0700
ddb6e78
change getInterestedLinks() by
2023-08-31 23:18:58 -0700
163ec7a
comment before pr by
2023-08-31 22:40:36 -0700
71d4d78
Merge remote-tracking branch 'origin/main' by
2023-08-31 15:46:47 -0700
803f4b4
debugged LionMarketplace, Nexus, and RobinhoodMarket by
2023-08-31 15:46:36 -0700
dfcd67a
added AnonMarket to mining and parser if statments by
2023-08-31 15:23:25 -0700
34af539
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test by
2023-08-31 15:13:30 -0700
033764c
AnonMarket crawler and parser completed by
2023-08-31 15:08:59 -0700
e9a3dc9
Image tracking. by
2023-08-31 13:28:09 -0700
19e8513
Images tracking. by
2023-08-31 12:46:16 -0700
bb00cde
AnonMarket crawler and parser completed by
2023-08-30 23:42:19 -0700
aac0b87
image debug for marketplaces by
2023-08-30 18:22:27 -0700
cca45ad
removed opentor() from all crawlers and set permissions.default.image to 3 by
2023-08-30 15:13:04 -0700
5a3725d
Merge remote-tracking branch 'origin/main' by
2023-08-30 12:19:05 -0700
9207c4f
Images. by
2023-08-30 12:18:12 -0700
fb1de6b
Merge remote-tracking branch 'origin/main' by
2023-08-29 17:30:18 -0700
baa6974
debugged forums by
2023-08-29 17:28:16 -0700
13ab033
Merge branch 'PEparsers' into 'main' by
2023-08-29 08:58:03 +0000
4856d79
finished PabloEscobarMarket parser by
2023-08-29 01:09:00 -0700
350e765
Merge branch 'nathan-dev' into 'main' by
2023-08-29 04:47:54 +0000
12c5c35
add metaverse market and pabloescobar market by
2023-08-28 21:42:09 -0700
493731a
changed forum function names to MKT by
2023-08-28 21:24:43 -0700
ff864f0
fixed parsing vendor rating for ThiefWorld by
2023-08-28 17:08:09 -0700
9fe1072
update marketsList.txt with completed markets by
2023-08-28 16:51:17 -0700
d5c78b3
debugged marketplaces by
2023-08-28 16:45:37 -0700
2731a8c
add DarkBazar by
2023-08-28 00:25:41 -0700
1a1e887
added new prepare_parser.py and cleaned output for marketplaces by
2023-08-25 14:58:44 -0700
4f6126a
Added Nexus to the mining and parser logic by
2023-08-23 15:08:23 -0700
212077d
Nexus Crawler & Parser completed by
2023-08-23 14:31:04 -0700
371d077
fixed circular import by
2023-08-22 17:41:20 -0700
dde9f49
added image aes encryption, base64 encoding, and html embedding to MarketPlaces by
2023-08-22 16:56:45 -0700
d1943e5
added image aes encryption, base64 encoding, and html embedding by
2023-08-22 16:35:10 -0700
97d9251
Db connection for Markets. by
2023-08-22 15:56:12 -0700
f0ec709
Merge remote-tracking branch 'origin/main' by
2023-08-22 15:53:28 -0700
ff071d8
Db connection for Markets. by
2023-08-22 15:53:04 -0700
2022abe
cleaned terminal output by
2023-08-20 18:05:53 -0700
47c851e
Db connection Markets and Forums. by
2023-08-19 21:54:28 -0700
f375e08
Db connection. by
2023-08-18 14:59:22 -0700
99ad530
new prepare_parser.py logic by
2023-08-18 14:49:46 -0700
beb4745
Added Robinhood Market crawler and parser by
2023-08-14 14:00:07 -0700
40fc164
Merge branch 'josh-dev' into 'main' by
2023-08-08 20:30:27 +0000
2bf3e74
Uncommented Commented things that shouldve been uncommented. also added item rating in listing parser. by
2023-08-04 19:28:41 -0700
be89dcf
Merge branch 'main' into josh-dev by
2023-08-03 20:26:19 -0700
0baf9ff
Finished Hiddenmarket Parser. Ran successful tests. Hiddenmarket complete by
2023-08-03 20:19:38 -0700
594e529
Working on Parser. Finished description parser. by
2023-07-27 10:28:58 -0700
2d561be
Finished crawler and fixed clean_html() so it still removes images but doesnt erase the whole line, just the link by
2023-07-20 21:22:50 -0700
a2bb661
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test by
2023-07-25 10:38:39 -0700
d90bf73
finished TorMarket by
2023-07-25 10:37:45 -0700
cac9357
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test by
2023-07-24 11:06:03 -0700