Commit Graph

1075 Commits

Author SHA1 Message Date
Azareal
ade8f82af7 add python and go user agents.
add new bot class for python, go and curl to reduce resource usage.
don't push canonicals for loggedin users
try to avoid pushing google site verify when it isn't necessary
give ahrefs the semrush treatment
2020-03-22 14:37:45 +10:00
Azareal
f86346ba22 reduce boilerplate in the client template builder
save a few more bytes in client templates
shave down img tags and global.js mini parse
remove comment in topic alt userinfo
2020-03-22 12:37:32 +10:00
Azareal
f074b5578c fix account tmpls breaking due to time elapsed changes 2020-03-22 12:20:13 +10:00
Azareal
75ed0cd5f2 save bytes in client templates 2020-03-22 10:25:10 +10:00
Azareal
5419af9c1c reduce table creation boilerplate in the patcher
prep for the tables table
2020-03-21 18:55:15 +10:00
Azareal
ebe93df622 localise yes / no on-off setting toggles 2020-03-21 17:46:43 +10:00
Azareal
22ec566a2c add website datenbank user agent
reduce redundancy and fix sublties in StaticFile()
2020-03-21 17:44:33 +10:00
Azareal
3d7f04b92b tweak renderTemplate3 for performance 2020-03-19 09:50:57 +10:00
Azareal
6a7b8fd3ee map msnbot to bing and avoid bytes for ahrefs too 2020-03-19 07:21:06 +10:00
Azareal
7d25937352 avoid csp for semrush 2020-03-18 19:45:36 +10:00
Azareal
b66a494f1c Revert "Revert "will a pointer make this faster...?""
This reverts commit 501bcc2425.
2020-03-18 19:21:34 +10:00
Azareal
501bcc2425 Revert "will a pointer make this faster...?"
This reverts commit 8e414486b8.
2020-03-15 21:34:57 +10:00
Azareal
8e414486b8 will a pointer make this faster...? 2020-03-15 17:06:44 +10:00
Azareal
20ce00f434 avoid unneccesary OGDesc allocs 2020-03-15 12:00:29 +10:00
Azareal
8d19048c0d reduce bytes used on semrush 2020-03-14 12:09:18 +10:00
Azareal
4d8858b846 don't do server pushes for unneccesary resources on ajax topics
save bytes in init.js
2020-03-13 19:02:28 +10:00
Azareal
bfea6b740f add cliqz, blexbot, curl user agents
add a /static/ redirect for the slower bots x.x
tweak slack, facebook ua phrases
avoid more allocs for ajax topic
2020-03-13 16:37:18 +10:00
Azareal
372508bf98 fix poll results on ajax topic and eliminate unnecessary allocs for resources that aren't used 2020-03-13 12:56:23 +10:00
Azareal
aa32bd335c try to avoid as many upfront gzip allocs to avoid wasting resources when they're not needed
avoid gzip for guests on routeAPI
2020-03-12 16:52:26 +10:00
Azareal
17c8f7604a rename avatar to img to save a few bytes in alerts 2020-03-12 13:29:19 +10:00
Azareal
61688a0c6d improve efficiency for small static files 2020-03-12 13:00:04 +10:00
Azareal
30b68945b4 guarantee more space for alerts 2020-03-12 11:08:56 +10:00
Azareal
c7c3dcead2 save bytes 2020-03-11 19:28:00 +10:00
Azareal
e19e478e32 try to iron out more ajax topic kinks 2020-03-11 19:13:05 +10:00
Azareal
64ec820453 add MojeekBot user agent 2020-03-11 18:54:11 +10:00
Azareal
d3336245d5 fix quoting on ajax topic load
apply #back classes properly on ajax topic load
2020-03-11 17:08:27 +10:00
Azareal
d43bffdec5 experiment with ajax load for topic
track route perf for BadRoute
2020-03-11 13:26:33 +10:00
Azareal
bba83ef727 save bytes 2020-03-10 07:41:17 +10:00
Azareal
d586220df2 add alternate duckduckgo ua 2020-03-09 20:49:22 +10:00
Azareal
42b38ae3d8 save bytes 2020-03-09 20:37:41 +10:00
Azareal
aa303dc14d use empty string instead of 0 for pruned ips
eliminate a WriteRune call in BuildAlertSb
2020-03-09 17:11:58 +10:00
Azareal
28f210371e try to optimise routeAPI 2020-03-09 15:16:44 +10:00
Azareal
b04d77d7b6 optimise topic lists by caching common qcounts for getList stmts
recalc forum topic counts
reduce thaw period to 3
cache top 8 forums instead of 5
optimise GetListByForum with zero topics
add Each method to ForumStore
2020-03-09 13:51:44 +10:00
Azareal
42a95d8597 initial Paginate() tests 2020-03-09 11:37:31 +10:00
Azareal
5007ddcb1e fix tests 2020-03-08 18:10:56 +10:00
Azareal
f5c9a34fdd simple top forum topiclist caching
reduce thaw period to 4
fix the _ ua bug
try using a hard period for routeAPI to avoid unneccessary churn for a return string that is unlikely to change
2020-03-08 18:04:37 +10:00
Azareal
6387e2bce0 fix safari ua matcher 2020-03-08 14:36:27 +10:00
Azareal
7d2be466b3 optimise ua tracking
reduce number of bytes used when we don't know the lang
add more spammy domain strings
2020-03-08 14:15:27 +10:00
Azareal
f55a7a23ba add haosou, proximic and mail_ru user agents
add pre_global js hook
try to fix archive.org ua patching
don't word split uas at _
2020-03-08 10:50:23 +10:00
Azareal
d22d6f0b27 add AhrefsBot user agent 2020-03-07 21:08:25 +10:00
Azareal
998cbbfd50 add MJ12bot user agent
add toutiao lang string
2020-03-07 20:46:27 +10:00
Azareal
a80c52861b add toutiao and alternate slack user agents
track route perf for avatars, robots.txt and opensearch
2020-03-07 15:28:25 +10:00
Azareal
46b23ee3a9 log unknown uas 2020-03-07 14:20:42 +10:00
Azareal
b1014d5647 add archive.org user agent 2020-03-07 13:49:44 +10:00
Azareal
ce306d2a4b add slurp, exabot, sogou and alexa user agents
try again to add aspiegelbot
2020-03-07 13:25:50 +10:00
Azareal
f3bdfffbed avoid allocs for guest alert etags
use phrase file modtime instead of instance start time for routeAPIPhrases to avoid cache churn
2020-03-07 12:59:06 +10:00
Azareal
42550269cc stop straining eyes on chart labels 2020-03-07 09:18:52 +10:00
Azareal
670b6186b5 avoid loading alerts in the panel in nox 2020-03-07 09:00:35 +10:00
Azareal
2b904b8b76 avoid embarrassment 2020-03-07 08:11:13 +10:00
Azareal
83a2659b1c this too x.x 2020-03-07 07:55:26 +10:00