58 Commits

Author SHA1 Message Date
fce720dbc9 Update README.md 2023-12-31 05:53:20 -06:00
942fd53309 Remove panic in Unsubscribe request 2023-12-31 05:53:11 -06:00
c0e27276e6 Pipeline details in README 2023-12-30 17:14:26 -06:00
ba8eadf1d9 Latest iteration on email processing, RandBool perf 2023-12-30 17:14:06 -06:00
1a00f791fa Info logs on new unseen emails 2023-12-30 17:13:05 -06:00
1662227606 Lower warn log level, skip empty emails 2023-12-30 16:24:39 -06:00
4e01cf0dbb Add log level flag 2023-12-30 16:24:16 -06:00
f1b3dd5ffa Add caching/marking abilities to unsubscription 2023-12-30 16:23:55 -06:00
41d1370588 Setup WaitGroups for email unsubscribing 2023-12-30 14:56:58 -06:00
f8ffafdb89 Add helpers for random bool, fake email generation 2023-12-30 14:56:31 -06:00
f7901569fc Add optional fake email unsubscribing, process emails in go routines 2023-12-30 14:43:07 -06:00
e6a3c9ca97 Use human representation of byte counts in content-length logs 2023-12-30 13:52:43 -06:00
62eaebafd7 Add caching version of GetFullEntry 2023-12-30 13:42:03 -06:00
3b5dab35bd Handle multiple names, fix string/rune conversion 2023-12-30 11:22:13 -06:00
764bd0947e Fix name processing for FullEntry, use rune instead of letter for directory getter 2023-12-30 11:05:36 -06:00
101900d4bd Use full URL in request log 2023-12-30 11:00:39 -06:00
653b110355 Launch multiple directory routines, GetFullEntry usage 2023-12-30 11:00:28 -06:00
bd643f0b86 Properly unescape entry ID, add row # check 2023-12-30 10:38:28 -06:00
b0479070f5 NormalizeTitle helper 2023-12-30 10:07:21 -06:00
756facf1b9 GetFullEntry (uncached) func 2023-12-30 10:07:10 -06:00
89c61b590e Process HREF into ID properly 2023-12-30 10:06:49 -06:00
f2aa872346 Setup pipelining 2023-12-30 02:51:16 -06:00
1a6ef0230a Clean up main func 2023-12-29 18:19:57 -06:00
88e3cbec24 function for requesting full directory 2023-12-29 18:14:48 -06:00
e549a3c014 Iterate all domains 2023-12-29 18:07:01 -06:00
6f2d1300f9 Warn on empty directory cache 2023-12-29 18:06:54 -06:00
a04a434a65 Setup domain rate limiter at secondary domain level 2023-12-29 18:06:43 -06:00
c86a80fcc0 Wrap errors instead of fmt.Error[f] 2023-12-29 14:14:54 -06:00
f2354d0cc9 Directory API Gets + Caching versions 2023-12-29 13:42:02 -06:00
105ab109d1 Show names of cookies saved/loaded in logs 2023-12-28 18:55:01 -06:00
d9815da783 Use common userAgent const 2023-12-28 14:00:28 -06:00
553779d574 Remove Keep-Alive headers from ApplyHeader helpers 2023-12-28 13:59:53 -06:00
695ce32446 Raise some logs from debug to info level 2023-12-28 13:52:31 -06:00
1a7b479679 Improve request helpers, add duration, add attributes to error cases 2023-12-28 13:52:13 -06:00
5fc7393f4c Fix CheckLogin never returning true 2023-12-28 13:51:26 -06:00
2cdba733c4 Check cookie name directly 2023-12-28 13:25:10 -06:00
40e39a035d Continue refining CheckLogin, only attempt Login after CheckLogin 2023-12-28 13:25:01 -06:00
7d13958532 Add configurable log level to badger logging
needed to clean up logs to just what i wanted
2023-12-28 12:59:41 -06:00
30b98a36f3 Finish cookie save/load 2023-12-28 12:54:55 -06:00
a69bf2e7cb Remove trailing newlines from badger logs 2023-12-28 12:54:40 -06:00
b452ac940a Setup BadgerDB logging constructs for zerolog 2023-12-28 10:19:23 -06:00
ed2e972134 Switch from levelDB to badgerDB 2023-12-28 10:19:11 -06:00
fcfe04dedb Make second request for logout btn check 2023-12-28 10:01:30 -06:00
f5c36f8452 Add goleveldb, comments 2023-12-28 10:01:22 -06:00
913c5b7841 Add README.md 2023-12-28 09:41:57 -06:00
c31d1073e3 Add comments to helper functions 2023-12-28 09:17:34 -06:00
79368126d3 Disable redirects, setup redirect check, cleanup login 2023-12-28 09:17:22 -06:00
4dcff9bc7b improve logon error retrun, add cookie/validation error/logout ability checks 2023-12-28 08:50:38 -06:00
8e78128b1e Separate SCLA/UTSA ApplyHeaders helper methods 2023-12-28 08:50:13 -06:00
ef7ca9f16e separate main code into different files (unsub, helpers) 2023-12-26 16:58:04 -06:00