Commit Graph

1075 Commits

Author SHA1 Message Date
Azareal ade8f82af7 add python and go user agents.
add new bot class for python, go and curl to reduce resource usage.
don't push canonicals for loggedin users
try to avoid pushing google site verify when it isn't necessary
give ahrefs the semrush treatment
2020-03-22 14:37:45 +10:00
Azareal f86346ba22 reduce boilerplate in the client template builder
save a few more bytes in client templates
shave down img tags and global.js mini parse
remove comment in topic alt userinfo
2020-03-22 12:37:32 +10:00
Azareal f074b5578c fix account tmpls breaking due to time elapsed changes 2020-03-22 12:20:13 +10:00
Azareal 75ed0cd5f2 save bytes in client templates 2020-03-22 10:25:10 +10:00
Azareal 5419af9c1c reduce table creation boilerplate in the patcher
prep for the tables table
2020-03-21 18:55:15 +10:00
Azareal ebe93df622 localise yes / no on-off setting toggles 2020-03-21 17:46:43 +10:00
Azareal 22ec566a2c add website datenbank user agent
reduce redundancy and fix sublties in StaticFile()
2020-03-21 17:44:33 +10:00
Azareal 3d7f04b92b tweak renderTemplate3 for performance 2020-03-19 09:50:57 +10:00
Azareal 6a7b8fd3ee map msnbot to bing and avoid bytes for ahrefs too 2020-03-19 07:21:06 +10:00
Azareal 7d25937352 avoid csp for semrush 2020-03-18 19:45:36 +10:00
Azareal b66a494f1c Revert "Revert "will a pointer make this faster...?""
This reverts commit 501bcc2425.
2020-03-18 19:21:34 +10:00
Azareal 501bcc2425 Revert "will a pointer make this faster...?"
This reverts commit 8e414486b8.
2020-03-15 21:34:57 +10:00
Azareal 8e414486b8 will a pointer make this faster...? 2020-03-15 17:06:44 +10:00
Azareal 20ce00f434 avoid unneccesary OGDesc allocs 2020-03-15 12:00:29 +10:00
Azareal 8d19048c0d reduce bytes used on semrush 2020-03-14 12:09:18 +10:00
Azareal 4d8858b846 don't do server pushes for unneccesary resources on ajax topics
save bytes in init.js
2020-03-13 19:02:28 +10:00
Azareal bfea6b740f add cliqz, blexbot, curl user agents
add a /static/ redirect for the slower bots x.x
tweak slack, facebook ua phrases
avoid more allocs for ajax topic
2020-03-13 16:37:18 +10:00
Azareal 372508bf98 fix poll results on ajax topic and eliminate unnecessary allocs for resources that aren't used 2020-03-13 12:56:23 +10:00
Azareal aa32bd335c try to avoid as many upfront gzip allocs to avoid wasting resources when they're not needed
avoid gzip for guests on routeAPI
2020-03-12 16:52:26 +10:00
Azareal 17c8f7604a rename avatar to img to save a few bytes in alerts 2020-03-12 13:29:19 +10:00
Azareal 61688a0c6d improve efficiency for small static files 2020-03-12 13:00:04 +10:00
Azareal 30b68945b4 guarantee more space for alerts 2020-03-12 11:08:56 +10:00
Azareal c7c3dcead2 save bytes 2020-03-11 19:28:00 +10:00
Azareal e19e478e32 try to iron out more ajax topic kinks 2020-03-11 19:13:05 +10:00
Azareal 64ec820453 add MojeekBot user agent 2020-03-11 18:54:11 +10:00
Azareal d3336245d5 fix quoting on ajax topic load
apply #back classes properly on ajax topic load
2020-03-11 17:08:27 +10:00
Azareal d43bffdec5 experiment with ajax load for topic
track route perf for BadRoute
2020-03-11 13:26:33 +10:00
Azareal bba83ef727 save bytes 2020-03-10 07:41:17 +10:00
Azareal d586220df2 add alternate duckduckgo ua 2020-03-09 20:49:22 +10:00
Azareal 42b38ae3d8 save bytes 2020-03-09 20:37:41 +10:00
Azareal aa303dc14d use empty string instead of 0 for pruned ips
eliminate a WriteRune call in BuildAlertSb
2020-03-09 17:11:58 +10:00
Azareal 28f210371e try to optimise routeAPI 2020-03-09 15:16:44 +10:00
Azareal b04d77d7b6 optimise topic lists by caching common qcounts for getList stmts
recalc forum topic counts
reduce thaw period to 3
cache top 8 forums instead of 5
optimise GetListByForum with zero topics
add Each method to ForumStore
2020-03-09 13:51:44 +10:00
Azareal 42a95d8597 initial Paginate() tests 2020-03-09 11:37:31 +10:00
Azareal 5007ddcb1e fix tests 2020-03-08 18:10:56 +10:00
Azareal f5c9a34fdd simple top forum topiclist caching
reduce thaw period to 4
fix the _ ua bug
try using a hard period for routeAPI to avoid unneccessary churn for a return string that is unlikely to change
2020-03-08 18:04:37 +10:00
Azareal 6387e2bce0 fix safari ua matcher 2020-03-08 14:36:27 +10:00
Azareal 7d2be466b3 optimise ua tracking
reduce number of bytes used when we don't know the lang
add more spammy domain strings
2020-03-08 14:15:27 +10:00
Azareal f55a7a23ba add haosou, proximic and mail_ru user agents
add pre_global js hook
try to fix archive.org ua patching
don't word split uas at _
2020-03-08 10:50:23 +10:00
Azareal d22d6f0b27 add AhrefsBot user agent 2020-03-07 21:08:25 +10:00
Azareal 998cbbfd50 add MJ12bot user agent
add toutiao lang string
2020-03-07 20:46:27 +10:00
Azareal a80c52861b add toutiao and alternate slack user agents
track route perf for avatars, robots.txt and opensearch
2020-03-07 15:28:25 +10:00
Azareal 46b23ee3a9 log unknown uas 2020-03-07 14:20:42 +10:00
Azareal b1014d5647 add archive.org user agent 2020-03-07 13:49:44 +10:00
Azareal ce306d2a4b add slurp, exabot, sogou and alexa user agents
try again to add aspiegelbot
2020-03-07 13:25:50 +10:00
Azareal f3bdfffbed avoid allocs for guest alert etags
use phrase file modtime instead of instance start time for routeAPIPhrases to avoid cache churn
2020-03-07 12:59:06 +10:00
Azareal 42550269cc stop straining eyes on chart labels 2020-03-07 09:18:52 +10:00
Azareal 670b6186b5 avoid loading alerts in the panel in nox 2020-03-07 09:00:35 +10:00
Azareal 2b904b8b76 avoid embarrassment 2020-03-07 08:11:13 +10:00
Azareal 83a2659b1c this too x.x 2020-03-07 07:55:26 +10:00