Commit Graph

28 Commits

Author SHA1 Message Date
agres dbb80e207b Now the connection witch is initialised is cleanly closed by the handler 2025-03-24 10:12:03 +01:00
agres 589f82345a Added debug function for verbose conole logging 2025-03-24 10:11:16 +01:00
agres 9febe63643 Added crash logging, extended the --export variable to define size of exorted data, setup verbose logging 2025-03-24 10:10:09 +01:00
agres aae9115b23 added a function witch sets the console handler to DEBUG level. this can be used for verbose logging 2025-03-24 10:09:13 +01:00
agres 10a490bf9c Logging refactor in auth 2025-03-23 23:27:28 +01:00
agres afe6a563ef Refactored logger 2025-03-23 23:22:41 +01:00
agres db983cfc8f Refactored to own logger 2025-03-23 23:19:12 +01:00
agres 87f84b250e Logging and documentation in scraper 2025-03-23 23:16:26 +01:00
agres f714200225 Extended logging and documentation for api handler 2025-03-23 23:05:29 +01:00
agres c65a1a8c8b Unified spotify api request into one function 2025-03-23 21:56:09 +01:00
agres 9d48f7bef7 Fixed counter bug 2025-03-23 21:55:38 +01:00
agres 7552d43702 Bigger batch size 2025-03-23 21:55:11 +01:00
agres e73752c015 Fixed counter issue where the accumilation would be calculated wrongly and the requests were not at the fullest capacity 2025-03-23 21:54:44 +01:00
agres 164ea9aca9 'fix' for a bug 2025-03-23 20:49:34 +01:00
agres af6b3dba13 The most convoluted, code-efficient, bloated, boilerplated, duplicated unneccecary undocumented, soon to be regretted code 2025-03-23 20:49:00 +01:00
Dominik ff9d726b47 Feat/import gdrp data (#26)
* Some simple code for extracting data from the jsons

* Jupiter Notebook

* Mac specific gitignore

* Fixed finding paths to floders

* Delete src/gdpr_data directory

* Updated gitignore to include my testing file

* Added the standard saving path for the database in the database handler, this way multiple files dont have to be updated when moving database position

* Moved the API usage wrappers into an own file, added a function for getting multiple track_ids at once, this still needs to be tested more

* Further code for extracting data from the gdpr files

* Forgor

* Final&Tested version of get_multiple_tracks_information endpoint

* Further functionality: The code now extracts the id of each listened song and makes a api call to get info about these songs via the multiple tracks api. Furthermore we track the songs witch the call is made for already and skip these

* Added function to map catalouged ids into the play history

* Added args parser to runtime program, cleaned up some code

* Fixed a bug where the database would always try to create tables, eaven if it exists

* Added some small text for clean interface

* Some final fixes to actual code, fixed db bug, reversed the order of database entries

* Some documentation

* Added -export args to docker runtime

* fix
2025-03-23 18:48:57 +01:00
Chris Kiriakou 38e0c69bea Move .env file to config dir, change db path for improved project structure
* Change path of db and token to `data` which helps to sperate source
  code from data files like `tokens.json` & `spotify_scraped.db`
* Change path of `.env` `src/env/` to `config/` for the same reason as
  mentioned above
* Added the newly created files to `.gitigore` accordingly
2025-03-21 18:57:13 +01:00
agres 601b94e405 Added timer to avoid working with cronjobs 2025-03-19 19:54:06 +01:00
agres 6b35a34826 refacor & simple logger 2025-03-19 19:38:22 +01:00
agres 7db5c51867 Big commit 2025-03-19 18:20:49 +01:00
Dominik e574c6bc00 Feat/auth multiple tokens integration (#15)
* Implemented a multiple token read/write/refresh function for the authentificator

* Rework auth with simple authentificate
2025-03-19 17:44:17 +01:00
agres 77654f13c9 Big commit 2025-03-19 16:27:25 +01:00
agres 12096b2ec0 Fixed doc 2025-03-19 01:07:42 +01:00
agres c3e3db87cc Added test newline 2025-03-19 01:06:52 +01:00
agres eb6a44a9b6 Implemented a token refresher/rotator and a token file so the user does not have to auth each time the code is ran 2025-03-18 21:43:40 +01:00
agres fb0911d893 A basic auth framework 2025-03-18 19:44:36 +01:00
agres 5b1be7bbe5 A Example env file 2025-03-18 19:43:56 +01:00
agres 1d6f07ef18 Initial setup for scraper 2025-03-18 17:16:18 +01:00