6bf73f3
updated parser for hiddenanswers by
2023-07-24 11:05:58 -0700
89fb117
fixed pagination issues with hiddenanswers crawler by
2023-07-24 11:04:01 -0700
bcf6ed0
completed lionmarketplace scraper by
2023-07-20 16:15:42 -0700
709ca19
Completed and tested parsers for Libre by
2023-07-20 15:10:39 -0700
6e1a1b6
completed Libre forum (not tested yet) by
2023-07-20 14:03:59 -0700
1154494
Completed and tested the parsers for DigitalThriftShop by
2023-07-20 13:50:29 -0700
ac80489
fixed merge conflicts by
2023-07-20 12:56:13 -0700
cf6ee1c
fixed local merge conlficts by
2023-07-20 12:55:18 -0700
811d1f6
removed all __pycache__ directories by
2023-07-20 19:37:23 +0000
d5ac121
darkmatter and m00key scraper verified by
2023-07-20 12:14:15 -0700
8ff65ec
resolve merge conflicts by
2023-07-19 13:16:18 -0700
afbe8d0
Completed and tested all parsers fro Cardingleaks forum by
2023-07-19 13:11:38 -0700
ccf2567
need to test DarkMatter scraper, tentatively finished by
2023-07-19 12:17:37 -0700
053bc28
Completed and tested all parsers for Altenens forum by
2023-07-19 10:56:09 -0700
a5a1f1b
Fixed setup.ini by
2023-07-19 09:57:53 -0700
05a33c9
Fixed setup.ini by
2023-07-19 09:46:48 -0700
4dcc9bf
First Commit. Added categories and started testing for crawler. by
2023-07-19 09:45:38 -0700
5045002
Merge branch 'josh-development' into 'main' by
2023-07-19 04:16:42 +0000
c4a9908
Merge branch 'main' into 'josh-development' by
2023-07-19 04:16:23 +0000
af01d48
m00nkey scraper completed by
2023-07-18 18:07:26 -0700
280fe88
m00nkey scraper completed by
2023-07-18 13:28:08 -0700
c3fc846
parsers not finished, pushed to be fixed by
2023-07-18 12:38:36 -0700
60f15c7
Merge branch 'main' into josh-development by
2023-07-17 19:50:55 -0700
c50fe11
Completed and Tested Vicecity by
2023-07-17 19:39:45 -0700
4133f34
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test by
2023-07-17 15:19:39 -0700
a6bdb89
Completed and tested all parsers for Procrax by
2023-07-17 15:19:22 -0700
2d51169
updated all marketplace crawlers by
2023-07-17 15:15:53 -0700
e066d37
resolved all merge conflicts by
2023-07-17 11:19:55 -0700
51f7920
Finished with parser for AnonymousMarketplace by
2023-07-16 17:05:39 -0700
b3188f4
updated all forum crawlers by
2023-07-14 13:28:25 -0700
abeb2c0
fixed bugs with crawler not getting all pages and parser breaking by
2023-07-14 12:21:36 -0700
73e1aff
fixed anonymous by
2023-07-14 11:37:42 -0700
d0ed351
finished torbay scraper finished m00nkey description parser. need to work on m00nkey listing by
2023-07-14 11:20:39 -0700
bd5a05f
finished crawler and parser by
2023-07-13 20:16:48 -0700
db93632
updated utilities.py to fix bug with clean_html() by
2023-07-13 19:59:40 -0700
3a66503
finished altenens parser changed naming scheme of multiple pages of topics by
2023-07-13 17:54:18 -0700
b404ffa
fixed merge conflict issues by
2023-07-12 17:53:52 -0700
101e17e
Completed parsers for AnonymousMarketplace & ThiefWorld by
2023-07-12 17:51:50 -0700
33a5379
fixed altenens by
2023-07-12 12:21:38 -0700
db08795
fixed procrax by
2023-07-12 09:39:31 -0700
fdd55fc
fixed carding leaks by
2023-07-12 09:32:06 -0700
da98edf
finished m00nkey crawler again. by
2023-07-11 21:36:29 -0700
ac491b9
removed html files by
2023-07-12 01:02:14 +0000
ca7bf38
changes to altenens and cryptbb parsers by
2023-07-11 17:58:32 -0700
8542717
brought back cardingleaks lost changes to monkey and procrax by
2023-07-11 17:37:55 -0700
e31ac59
procrax, cardingleaks, m00nkeymarket - crawler completed by
2023-07-11 17:04:27 -0700
134c2fa
Re-added all .txt files by
2023-07-11 16:45:56 -0700
86bdddc
procrax, cardingleaks - craweler completed by
2023-07-11 15:43:26 -0700
84c785f
Removed all gitignore files from repository by
2023-07-11 15:43:09 -0700
c34bc73
Merge remote-tracking branch 'origin/main' by
2023-07-11 15:25:26 -0700
cadb37a
Completed and fully tested all parsers for Apocaplypse by
2023-07-11 15:14:34 -0700
0582baa
Merge remote-tracking branch 'origin/main' by
2023-07-10 12:49:05 -0700
3cbfdb8
removed html by
2023-07-06 04:04:01 +0000
9a40fed
edit to .gitignore by
2023-07-06 03:50:21 +0000
a8ebf3c
Merge remote-tracking branch 'origin/main' by
2023-07-05 12:18:02 -0700
e13f8a0
fixed setup.ini by
2023-07-03 17:29:59 -0700
2d09636
deleted old file from .idea by
2023-07-03 22:10:05 +0000
e6a34d7
deleted old files by
2023-07-03 22:07:08 +0000
1db0af1
resolve merge conflicts in setup.ini by
2023-07-03 12:35:45 -0700
3751c7a
attempt to fix current git issues by
2023-07-03 12:33:52 -0700
76ccc68
new format by
2023-07-03 12:27:47 -0700
808829a
Merge branch 'khoi-dev' into 'main' by
2023-07-01 00:06:53 +0000
adf046c
Merge branch 'khoi-dev' of https://gitlab.com/dw9372422/dw_pipeline_test into khoi-dev by
2023-06-30 17:05:23 -0700
98627d3
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test into khoi-dev by
2023-06-30 17:02:55 -0700
547dc8a
Updated testing.py for OnniForums by
2023-06-30 17:02:30 -0700
8ed6830
Update .gitignore by
2023-06-30 21:20:03 +0000
3784e8d
Updates from virtual machine by
2023-06-29 14:30:14 -0700
2524cdd
Updates from virtual machine by
2023-06-29 14:26:44 -0700
98de158
new format by
2023-06-29 12:59:45 -0700
30b1ab8
save html to shared folder rest of markets: tor2door, torbay, and tormarket by
2023-06-29 12:57:45 -0700
3d30e70
save html to shared folder rest of forums edits by
2023-06-29 12:53:41 -0700
7493fb3
save html to shared folder examples by
2023-06-29 12:38:01 -0700
e94db99
Merge remote-tracking branch 'origin/main' by
2023-06-29 11:47:43 -0700
0227f96
added more documentation, finished darkmatter marketplace crawler, finished newparser changes now will add topic pages to the first page library by
2023-06-29 11:45:47 -0700
6485ddb
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test into khoi-dev by
2023-06-29 10:36:44 -0700
c092986
Created test file for class-based organization for parser data by
2023-06-29 10:35:16 -0700
4856cd9
Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test by
2023-06-29 08:56:37 -0700
d714918
description and listing parser for AbyssForums by
2023-06-29 08:54:29 -0700
b71c874
change to cryptbb by
2023-06-28 16:21:14 -0700
a61a048
Completed description parser for ThiefWorld by
2023-06-27 17:06:57 -0700
4946e13
Merge branch 'khoi-dev' of https://gitlab.com/dw9372422/dw_pipeline_test into khoi-dev by
2023-06-27 15:54:04 -0700
1388cce
hotfix: resolve merge conflicts from main by
2023-06-27 15:53:49 -0700
073473a
Edited OnniForums parser to comply with database schema by
2023-06-27 15:51:14 -0700
a4f6f60
Latest changes for Justin by
2023-06-27 14:07:57 -0700
e327ce6
finished onniforums improvements, finished apocalypse marketplace, and am working on other improvements... added more documentation. by
2023-06-27 14:02:09 -0700
3313d17
Merge remote-tracking branch 'origin/main' by
2023-06-27 12:55:22 -0700
1bb7780
Finished with description parser for MikesGrandStore by
2023-06-27 12:05:51 -0700
d508819
fiished hiddenanswers forum, started work on apocalypse marketplace (but having trouble debugging due to the captcha no loading) by
2023-06-26 13:15:10 -0700
9a87c51
Started with building parser for MikesGrandStore by
2023-06-26 11:37:50 -0700
7bbf9c2
Save current progress by
2023-06-26 10:41:27 -0700
6b8ea82
finished more crawlers by
2023-06-23 08:46:31 -0700
2f27de3
hotfix: resolve merge conflicts by
2023-06-22 14:19:18 -0700
57f7b07
Finished parser for OnniForums by
2023-06-22 14:13:38 -0700
b5a26d3
finished mikes grand store crawler by
2023-06-21 15:16:38 -0700
3e5b6fc
debugged abyssforum, completed tormarket crawler. started altenens forum by
2023-06-21 10:20:47 -0700
2f39f4c
Merge remote-tracking branch 'origin/main' by
2023-06-21 07:43:20 -0700
2963490
completed abyssforum crawler by
2023-06-21 07:42:42 -0700
c470604
demo run edits by
2023-06-20 17:43:45 -0700
5edd790
made it compatible by
2023-06-20 16:37:55 -0700
5044710
completed LionMarketplace and TorBay crawlers by
2023-06-20 15:50:14 -0700