Commit Graph

  • 6bf73f3 updated parser for hiddenanswers by Khoi 2023-07-24 11:05:58 -0700
  • 89fb117 fixed pagination issues with hiddenanswers crawler by Khoi 2023-07-24 11:04:01 -0700
  • bcf6ed0 completed lionmarketplace scraper by Helium 2023-07-20 16:15:42 -0700
  • 709ca19 Completed and tested parsers for Libre by Khoi 2023-07-20 15:10:39 -0700
  • 6e1a1b6 completed Libre forum (not tested yet) by Khoi 2023-07-20 14:03:59 -0700
  • 1154494 Completed and tested the parsers for DigitalThriftShop by Khoi 2023-07-20 13:50:29 -0700
  • ac80489 fixed merge conflicts by Khoi 2023-07-20 12:56:13 -0700
  • cf6ee1c fixed local merge conlficts by Khoi 2023-07-20 12:55:18 -0700
  • 811d1f6 removed all __pycache__ directories by westernmeadow 2023-07-20 19:37:23 +0000
  • d5ac121 darkmatter and m00key scraper verified by Helium 2023-07-20 12:14:15 -0700
  • 8ff65ec resolve merge conflicts by Khoi 2023-07-19 13:16:18 -0700
  • afbe8d0 Completed and tested all parsers fro Cardingleaks forum by Khoi 2023-07-19 13:11:38 -0700
  • ccf2567 need to test DarkMatter scraper, tentatively finished by Helium 2023-07-19 12:17:37 -0700
  • 053bc28 Completed and tested all parsers for Altenens forum by Khoi 2023-07-19 10:56:09 -0700
  • a5a1f1b Fixed setup.ini by Joshua 2023-07-19 09:57:53 -0700
  • 05a33c9 Fixed setup.ini by Joshua 2023-07-19 09:46:48 -0700
  • 4dcc9bf First Commit. Added categories and started testing for crawler. by Joshua 2023-07-19 09:45:38 -0700
  • 5045002 Merge branch 'josh-development' into 'main' by westernmeadow 2023-07-19 04:16:42 +0000
  • c4a9908 Merge branch 'main' into 'josh-development' by westernmeadow 2023-07-19 04:16:23 +0000
  • af01d48 m00nkey scraper completed by Helium 2023-07-18 18:07:26 -0700
  • 280fe88 m00nkey scraper completed by Helium 2023-07-18 13:28:08 -0700
  • c3fc846 parsers not finished, pushed to be fixed by Helium 2023-07-18 12:38:36 -0700
  • 60f15c7 Merge branch 'main' into josh-development by Joshua 2023-07-17 19:50:55 -0700
  • c50fe11 Completed and Tested Vicecity by Joshua 2023-07-17 19:39:45 -0700
  • 4133f34 Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test by Khoi 2023-07-17 15:19:39 -0700
  • a6bdb89 Completed and tested all parsers for Procrax by Khoi 2023-07-17 15:19:22 -0700
  • 2d51169 updated all marketplace crawlers by westernmeadow 2023-07-17 15:15:53 -0700
  • e066d37 resolved all merge conflicts by Khoi 2023-07-17 11:19:55 -0700
  • 51f7920 Finished with parser for AnonymousMarketplace by Khoi 2023-07-16 17:05:39 -0700
  • b3188f4 updated all forum crawlers by Helium 2023-07-14 13:28:25 -0700
  • abeb2c0 fixed bugs with crawler not getting all pages and parser breaking by Joshua 2023-07-14 12:21:36 -0700
  • 73e1aff fixed anonymous by Helium 2023-07-14 11:37:42 -0700
  • d0ed351 finished torbay scraper finished m00nkey description parser. need to work on m00nkey listing by Helium 2023-07-14 11:20:39 -0700
  • bd5a05f finished crawler and parser by Joshua 2023-07-13 20:16:48 -0700
  • db93632 updated utilities.py to fix bug with clean_html() by Joshua 2023-07-13 19:59:40 -0700
  • 3a66503 finished altenens parser changed naming scheme of multiple pages of topics by westernmeadow 2023-07-13 17:54:18 -0700
  • b404ffa fixed merge conflict issues by Khoi 2023-07-12 17:53:52 -0700
  • 101e17e Completed parsers for AnonymousMarketplace & ThiefWorld by Khoi 2023-07-12 17:51:50 -0700
  • 33a5379 fixed altenens by Helium 2023-07-12 12:21:38 -0700
  • db08795 fixed procrax by Helium 2023-07-12 09:39:31 -0700
  • fdd55fc fixed carding leaks by Helium 2023-07-12 09:32:06 -0700
  • da98edf finished m00nkey crawler again. by Helium 2023-07-11 21:36:29 -0700
  • ac491b9 removed html files by westernmeadow 2023-07-12 01:02:14 +0000
  • ca7bf38 changes to altenens and cryptbb parsers by westernmeadow 2023-07-11 17:58:32 -0700
  • 8542717 brought back cardingleaks lost changes to monkey and procrax by Helium 2023-07-11 17:37:55 -0700
  • e31ac59 procrax, cardingleaks, m00nkeymarket - crawler completed by Helium 2023-07-11 17:04:27 -0700
  • 134c2fa Re-added all .txt files by Khoi 2023-07-11 16:45:56 -0700
  • 86bdddc procrax, cardingleaks - craweler completed by Helium 2023-07-11 15:43:26 -0700
  • 84c785f Removed all gitignore files from repository by Khoi 2023-07-11 15:43:09 -0700
  • c34bc73 Merge remote-tracking branch 'origin/main' by Helium 2023-07-11 15:25:26 -0700
  • cadb37a Completed and fully tested all parsers for Apocaplypse by Khoi 2023-07-11 15:14:34 -0700
  • 0582baa Merge remote-tracking branch 'origin/main' by Helium 2023-07-10 12:49:05 -0700
  • 3cbfdb8 removed html by westernmeadow 2023-07-06 04:04:01 +0000
  • 9a40fed edit to .gitignore by westernmeadow 2023-07-06 03:50:21 +0000
  • a8ebf3c Merge remote-tracking branch 'origin/main' by Helium 2023-07-05 12:18:02 -0700
  • e13f8a0 fixed setup.ini by westernmeadow 2023-07-03 17:29:59 -0700
  • 2d09636 deleted old file from .idea by westernmeadow 2023-07-03 22:10:05 +0000
  • e6a34d7 deleted old files by westernmeadow 2023-07-03 22:07:08 +0000
  • 1db0af1 resolve merge conflicts in setup.ini by Helium 2023-07-03 12:35:45 -0700
  • 3751c7a attempt to fix current git issues by Helium 2023-07-03 12:33:52 -0700
  • 76ccc68 new format by Helium 2023-07-03 12:27:47 -0700
  • 808829a Merge branch 'khoi-dev' into 'main' by Khoi 2023-07-01 00:06:53 +0000
  • adf046c Merge branch 'khoi-dev' of https://gitlab.com/dw9372422/dw_pipeline_test into khoi-dev by Khoi 2023-06-30 17:05:23 -0700
  • 98627d3 Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test into khoi-dev by Khoi 2023-06-30 17:02:55 -0700
  • 547dc8a Updated testing.py for OnniForums by Khoi 2023-06-30 17:02:30 -0700
  • 8ed6830 Update .gitignore by westernmeadow 2023-06-30 21:20:03 +0000
  • 3784e8d Updates from virtual machine by Khoi 2023-06-29 14:30:14 -0700
  • 2524cdd Updates from virtual machine by Khoi 2023-06-29 14:26:44 -0700
  • 98de158 new format by Helium 2023-06-29 12:59:45 -0700
  • 30b1ab8 save html to shared folder rest of markets: tor2door, torbay, and tormarket by westernmeadow 2023-06-29 12:57:45 -0700
  • 3d30e70 save html to shared folder rest of forums edits by westernmeadow 2023-06-29 12:53:41 -0700
  • 7493fb3 save html to shared folder examples by westernmeadow 2023-06-29 12:38:01 -0700
  • e94db99 Merge remote-tracking branch 'origin/main' by Helium 2023-06-29 11:47:43 -0700
  • 0227f96 added more documentation, finished darkmatter marketplace crawler, finished newparser changes now will add topic pages to the first page library by Helium 2023-06-29 11:45:47 -0700
  • 6485ddb Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test into khoi-dev by Khoi 2023-06-29 10:36:44 -0700
  • c092986 Created test file for class-based organization for parser data by Khoi 2023-06-29 10:35:16 -0700
  • 4856cd9 Merge branch 'main' of https://gitlab.com/dw9372422/dw_pipeline_test by dabadcuber5 2023-06-29 08:56:37 -0700
  • d714918 description and listing parser for AbyssForums by dabadcuber5 2023-06-29 08:54:29 -0700
  • b71c874 change to cryptbb by joey 2023-06-28 16:21:14 -0700
  • a61a048 Completed description parser for ThiefWorld by Khoi 2023-06-27 17:06:57 -0700
  • 4946e13 Merge branch 'khoi-dev' of https://gitlab.com/dw9372422/dw_pipeline_test into khoi-dev by Khoi 2023-06-27 15:54:04 -0700
  • 1388cce hotfix: resolve merge conflicts from main by Khoi 2023-06-27 15:53:49 -0700
  • 073473a Edited OnniForums parser to comply with database schema by Khoi 2023-06-27 15:51:14 -0700
  • a4f6f60 Latest changes for Justin by dabadcuber5 2023-06-27 14:07:57 -0700
  • e327ce6 finished onniforums improvements, finished apocalypse marketplace, and am working on other improvements... added more documentation. by Helium 2023-06-27 14:02:09 -0700
  • 3313d17 Merge remote-tracking branch 'origin/main' by dabadcuber5 2023-06-27 12:55:22 -0700
  • 1bb7780 Finished with description parser for MikesGrandStore by Khoi 2023-06-27 12:05:51 -0700
  • d508819 fiished hiddenanswers forum, started work on apocalypse marketplace (but having trouble debugging due to the captcha no loading) by Helium 2023-06-26 13:15:10 -0700
  • 9a87c51 Started with building parser for MikesGrandStore by Khoi 2023-06-26 11:37:50 -0700
  • 7bbf9c2 Save current progress by dabadcuber5 2023-06-26 10:41:27 -0700
  • 6b8ea82 finished more crawlers by Helium 2023-06-23 08:46:31 -0700
  • 2f27de3 hotfix: resolve merge conflicts by Khoi 2023-06-22 14:19:18 -0700
  • 57f7b07 Finished parser for OnniForums by Khoi 2023-06-22 14:13:38 -0700
  • b5a26d3 finished mikes grand store crawler by Helium 2023-06-21 15:16:38 -0700
  • 3e5b6fc debugged abyssforum, completed tormarket crawler. started altenens forum by Helium 2023-06-21 10:20:47 -0700
  • 2f39f4c Merge remote-tracking branch 'origin/main' by Helium 2023-06-21 07:43:20 -0700
  • 2963490 completed abyssforum crawler by Helium 2023-06-21 07:42:42 -0700
  • c470604 demo run edits by westernmeadow 2023-06-20 17:43:45 -0700
  • 5edd790 made it compatible by Helium 2023-06-20 16:37:55 -0700
  • 5044710 completed LionMarketplace and TorBay crawlers by Helium 2023-06-20 15:50:14 -0700