While shutting down terminal windows to the SN servers this morning, one of them had the create table syntax for the comments table still on screen. I gave it a read through just because it was there and noticed that there wasn't an index for the opid (top level comment id for speeding up entire thread pulling) column. So I got some before numbers, added one, and ran some After tests. Heavily commented stories show a 50-150% pages-per-second speed increase in threaded views. Low hanging fruit FTW.
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
(1)
(1)
(Score: 5, Insightful) by Bobs on Wednesday January 09 2019, @01:45PM
Thank you!
(Score: 5, Interesting) by realDonaldTrump on Wednesday January 09 2019, @02:02PM (22 children)
The stories with a lot of Tweets, they go into so many Pages. Because the cyber -- they said -- was too slow. An the Pages are a big headache. As everyone knows. But the cyber is faster now. So possibly they don't need the Pages anymore. Hopefully they don't need those with the fast new digital.
(Score: 3, Interesting) by The Mighty Buzzard on Wednesday January 09 2019, @02:04PM (18 children)
We might indeed be able to raise the 100 comment per page limit. It'll need some testing though.
My rights don't end where your fear begins.
(Score: 2) by zocalo on Wednesday January 09 2019, @02:12PM (7 children)
OK, I know there have been a few, but it's still pretty rare, but well done on spotting the missing index and taking the time to investigate further anyway. Faster load times = more time to read and comment!
UNIX? They're not even circumcised! Savages!
(Score: 2) by The Mighty Buzzard on Wednesday January 09 2019, @02:33PM (6 children)
Ten in the last thirty days. Two of them journal entries. That's not bad for us for a month heavy on holiday stuff.
My rights don't end where your fear begins.
(Score: 5, Funny) by Runaway1956 on Wednesday January 09 2019, @02:55PM (5 children)
I told you I'd be back to help you finish off the ham, and all those pies. But, did you listen? Noooooooooooo - you ate it all yourself. Now you're gonna complain about heavy? I don't wanna hear it. No sympathy from me that you have to turn sideways to get through the door.
(Score: 3, Touché) by The Mighty Buzzard on Wednesday January 09 2019, @03:11PM (4 children)
Man, I only put on five pounds between the big food holidays and having to eat more often for ten days of thrice-a-day antibiotics. Since I lost 35 pounds or so over the past year, I'm calling that a win.
My rights don't end where your fear begins.
(Score: 2) by Runaway1956 on Wednesday January 09 2019, @04:50PM (3 children)
Ugghhhh - hate those meds. And, they suck even more during the holiday season.
(Score: 2) by The Mighty Buzzard on Thursday January 10 2019, @04:09AM (2 children)
First time I've taken any since my 20s. They're just as annoying now as then. And the dipshit PA felt the need to prescribe me not one but two bloody decongestants after I told him the infection had my sinuses the clearest they had been in decades.
My rights don't end where your fear begins.
(Score: 2) by Runaway1956 on Thursday January 10 2019, @02:35PM (1 child)
Sinuses? Try scuba diving. They gave me hell through my teens. Guess I was 20, almost 21 when I took my diving lessons. We got out of the kiddy pool, and went on our first real dive, diddling around at around fifty feet. My ears popped, and I started running at the nose, head felt weird, and I headed to the surface. I was a god-awful mess for a couple hours, but I've never had sinus problems like I did in my teens. I suppose if I had ever described the experience to a nose-throat-and-ear specialist, he could have explained it. All I know is, life changed when I took up diving.
(Score: 2) by The Mighty Buzzard on Thursday January 10 2019, @05:13PM
Allergies have kept mine half plugged since my late teens. The sinus infection had them almost entirely clear. Weirdness doth abound in my general vicinity.
My rights don't end where your fear begins.
(Score: 3, Interesting) by takyon on Wednesday January 09 2019, @03:22PM (6 children)
Wouldn't this break existing URLs that link to specific pages?
[SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]
(Score: 2) by kazzie on Wednesday January 09 2019, @04:41PM
Are there (m)any of those?
I suppose one could only raise the bar on stories newer than $date to maintain compatibility.
(Score: 3, Informative) by martyb on Wednesday January 09 2019, @11:19PM
tl;dr: Depends on what you mean by 'existing'. A URL containing a page reference that you had saved away, say, as a bookmark could be a problem. But any accesses to different pages while a given page size is in effect should work fine.
Try it! Logged-in users can already set a preference for how many comments they want to see in a page:
See your new page size in effect.
Now, given all that... if you had previously saved a link to a comment externally that referred to a particular 'page' of comments, and then tried to open that link with a new page size in effect, then, well that won't work.
Wit is intellect, dancing.
(Score: 2) by The Mighty Buzzard on Thursday January 10 2019, @04:10AM (3 children)
If you're linking to specific pages, you're doing it wrong. How many are on a page is up to each individual user, so you can't have any idea what page a given comment is on.
My rights don't end where your fear begins.
(Score: 3, Interesting) by takyon on Thursday January 10 2019, @03:03PM (2 children)
So the comment permalinks have "page=N" on them. I changed my comments per page limit to 10 and it produces another number for the page. But both links display the exact same thing since they are actually looking at CID:
https://soylentnews.org/comments.pl?noupdate=1&sid=29494&page=2&cid=783383#commentwrap [soylentnews.org]
https://soylentnews.org/comments.pl?noupdate=1&sid=29494&page=6&cid=783383#commentwrap [soylentnews.org]
https://soylentnews.org/comments.pl?noupdate=1&sid=29494&page=190&cid=783383#commentwrap [soylentnews.org]
https://soylentnews.org/comments.pl?noupdate=1&sid=29494&page=1904249&cid=783383#commentwrap [soylentnews.org]
As you can see, even changing the page number to something absurd works.
So why is "page=N" even in the comment permalinks? Isn't it redundant linkcruft? It seems that we could remove that part.
[SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]
(Score: 2) by The Mighty Buzzard on Thursday January 10 2019, @05:16PM
Man, don't ask me today. I woke up late to db issues on both our bloody db servers and having to add 3-4 new sysadmins so people other than me can put out fires. My brain's fairly well toast.
My rights don't end where your fear begins.
(Score: 2) by The Mighty Buzzard on Friday January 11 2019, @12:19PM
Okay, now that I can read English again, I think that's "working as intended" though permalinks having a page number in them in the first place may not be. When you supply a cid it should show you only that comment and any below it, thread-wise. If, and only if, those comments add up to more than your max comments per page setting, they should paginate based on the comments immediately below the one whose cid was supplied. Invalid page numbers should show the first page.
My rights don't end where your fear begins.
(Score: 3, Funny) by RandomFactor on Wednesday January 09 2019, @10:54PM (1 child)
You.... You understood that.
В «Правде» нет известий, в «Известиях» нет правды
(Score: 2) by The Mighty Buzzard on Thursday January 10 2019, @04:13AM
His dumbassery ain't got nothin on some of the guys I grew up with.
My rights don't end where your fear begins.
(Score: 2) by Reziac on Thursday January 10 2019, @02:27AM
Noticeable improvement -- it's always been slow to redisplay post-moderating, and now it's not. So you fixed something. There, aren't you glad I broke it? :D
And there is no Alkibiades to come back and save us from ourselves.
(Score: 0) by Anonymous Coward on Wednesday January 09 2019, @03:06PM (2 children)
I knew it!
This can't be the readDonaldTrump because he speaks far too clearly and makes too much sense!
(Score: 0) by Anonymous Coward on Wednesday January 09 2019, @11:22PM
It's just another clone.
(Score: 3, Interesting) by realDonaldTrump on Thursday January 10 2019, @11:23PM
I'm a professional at Technology. I'm like really smart.
(Score: -1, Redundant) by Anonymous Coward on Wednesday January 09 2019, @05:22PM (8 children)
Glad you finally did your job!
(Score: 2) by pkrasimirov on Wednesday January 09 2019, @11:46PM (7 children)
Yeah, he finally earned his salary, right?
(Score: 2) by The Mighty Buzzard on Thursday January 10 2019, @04:15AM (6 children)
I think I'll demand a raise from NCommander tomorrow. It's a new year and inflation's made my $0 worth around 2% less.
My rights don't end where your fear begins.
(Score: 3, Interesting) by realDonaldTrump on Friday January 11 2019, @11:55AM (5 children)
So many of our best workers -- and my biggest supporters -- work, very proudly, for free. Thank you! #ShutdownStories [twitter.com]
(Score: 2) by The Mighty Buzzard on Friday January 11 2019, @12:23PM (4 children)
I don't really work for free. I get paid in interesting news, well above average discussions about it to participate in, and dumbass comments about it to mock.
My rights don't end where your fear begins.
(Score: 2) by edIII on Friday January 11 2019, @11:36PM (3 children)
Well that won't do.... You should start a GoFundMe for good Whiskey. I'd pitch in to buy you a drink :)
Technically, lunchtime is at any moment. It's just a wave function.
(Score: 2) by The Mighty Buzzard on Saturday January 12 2019, @03:54AM (2 children)
Nah, I'd just embezzle it and blow it all on fishing gear. Better to avoid the temptation.
My rights don't end where your fear begins.
(Score: 2) by edIII on Saturday January 12 2019, @08:27AM (1 child)
But I thought good Whiskey was included in fishing gear...
Technically, lunchtime is at any moment. It's just a wave function.
(Score: 2) by The Mighty Buzzard on Saturday January 12 2019, @11:34AM
Well, it can be but unlike beer it requires an additional hydration source and something sammich-like so you don't have to stop fishing. Whiskey's only part of your balanced breakfast not the whole thing.
My rights don't end where your fear begins.
(Score: 2, Interesting) by Anonymous Coward on Wednesday January 09 2019, @07:52PM (1 child)
With that discovery, I wonder if there are other missing indexes or with columns in the wrong order. Maybe you should try some EXPLAIN QUERY PLAN queries with your usual DML statements. That might also reveal instances where a covering index might be handy. An ANALYZE statement may also help your query planner (depending on your DB engine), but that may not be worth the minimal gain.
(Score: 1, Interesting) by Anonymous Coward on Thursday January 10 2019, @03:12AM
Just an FYI: The statement EXPLAIN QUERY PLAN isn't standard SQL, so the exact command differs depending on the exact implementation you are using. Sometimes it is EXPLAIN QUERY PLAN, EXPLAIN ANALYZE, or EXPLAIN VERBOSE, among some of the other options.
(Score: 2) by Kilo110 on Wednesday January 09 2019, @08:13PM (3 children)
Where's my bitcoin subscription option?
(Score: 2) by Kilo110 on Wednesday January 09 2019, @08:15PM (2 children)
I'm blind.
(Score: 2) by Kilo110 on Wednesday January 09 2019, @08:22PM (1 child)
I went to subscribe with bitcoin and it didn't work. So my original comment still stands.
(Score: 2) by The Mighty Buzzard on Thursday January 10 2019, @04:25AM
Stripe stopped supporting BTC around the time transaction fees became larger than a year's subscription here. Yes, we do need to remove the outdated info though.
As for a new cryptocoin option, I'm a bit sick of dealing with trendy, short attention span assholes who think it's okay to have a non-versioned API and break backwards compatibility a couple times a year when you're dealing with people's money. If anyone wants to write up a plugin for their favorite "you pay in cryptocoins, SN gets cash money" service, I'll code review it and merge it. Hell, I'll even help if you need it. I'm not going to code any more modules to use an API that's not going to work in six months though.
My rights don't end where your fear begins.
(Score: 2) by linkdude64 on Wednesday January 09 2019, @09:19PM
Good goin'
(Score: 3, Funny) by ilsa on Wednesday January 09 2019, @10:44PM (2 children)
Sometimes all it takes is one small but critical detail.
Reminds me of a developer who complained that one of the pages they wrote has started running slow and complained about the infrastructure being inadequate.
After some investigation, it turned out they were doing a select * on blah without a where clause, and some recent work populated that table by several 100k rows. Well no kidding your query is going to run slow!
The real kick in the pants was that the developer was only looking for ONE row. They were loading the entire table and then looping through the results till they found what they wanted. *facepalm*
(Score: 2, Funny) by Anonymous Coward on Friday January 11 2019, @03:40AM (1 child)
I saw something like that once. They got all the results from an unindexed flat-file database, looped through it looking for what they wanted. The worst part is that the loop didn't break once it was found, they just continued looping.
(Score: 2) by The Mighty Buzzard on Friday January 11 2019, @12:28PM
Could have been a religious imperative.
♫ Will the circle be unbroken / By and by, Lord, by and by / There's a better home a-waiting / In the sky, Lord, in the sky ♫
My rights don't end where your fear begins.