View Full Version : Erm...what the heck are you doing with our reviews?
Aiko
Mar 29, 2004, 03:06 AM
Hi,
i just wanted to download some old elite battle packs such as Blade's Battle Pack Vol. 2, which can be found here: http://www.jazz2online.com/downloads/moreinfo.php?levelid=373
To my surprise and horror nearly all ratings were removed and a lot of pretty insolent and authotarian blabla was put there instead by some guy called Violet CLM.
Here are some quotes, and remember that we are talking about Blade's awesome second Battle pack:
"WRONG. There is lots more to say. Rating removal. ~Violet"
"Borderline, but not enough detail, too unsupported. Rating removal. ~Violet"
"This review is just unacceptable. Detail or don't rate. Rating removal. ~Violet"
I guess someone is going a bit too far here? Tsk...
What are you doing with our three year old(!!) download ratings? I didn't see you around back then...!? And what is this all about? What happened to my beloved Jazz2Online download section, where i did 534 reviews? Does Fquist know about this?? I'm asking for an explanation and or apology.
ShadowGPW
Mar 29, 2004, 03:32 AM
Trafton seems to like it aswell to remove old comments and filter acient reviews/links etc.
$tilettø
Mar 29, 2004, 03:49 AM
yes they are going very far. imo. ( Trafton and Violet.)
why do you care? its not like you can change anything.. i just ignore it..
Derby: Personal attack removal.
Link
Mar 29, 2004, 04:20 AM
I think the idea is that reviews should give enough detail to support the rating and shouldn't be biased toward the author. I completely agree with Violet removing the rating on a review like "Because this is maybe Blades last release, and because blade is one of the best JJ2 tileset makers ever, i'll rate it, but i won't review."
However, the guidelines about reviews\ratings weren't in place when these levels were uploaded. Going back and editing them is almost destroying JJ2 history. It's definitely possible for people to have an opinion about a level without writing a detailed review - something that is not allowed now, but was at least somewhat allowed back then.
I also don't think Shadow should be putting ratings back after Violet edited them out. It would make more sense for the J2O admins to discuss this properly: someone complained, so they should review their policies and act accordingly.
mirrow
Mar 29, 2004, 04:37 AM
And overall are we a very strict society on j2o where everything must match with the guidelines.. It can't be that someone gives a rating without explaining in detail. Why he gives that rating to a 2D platform game. Jazzjackrabbit. Fun is not a point. If we would act like this, no one would know why we rate it like that!! And anyway more people tend to just quick rate then which would lead to a better average rating but now finally people are encouraged to rate only if they have 20minutes time for a big detailed review. So we can be sure that everyone reads all reviews and then looks at the rating and see a reason and so only those reviews count as real opinion from someone and show a bettter rating than a big average.
RIIIIGGGGGHHHHHTTTTT
Stiletto i agree ;)
Admins plz delete this..
Aiko
Mar 29, 2004, 04:44 AM
Erm, we had very good and working "guidelines" back then. It's just they weren't unfairly harsh like the new ones obviously are.
If someone writes
"Nothing to say Perfect Pack, nice lvls, nice tilesets, cool musics, you need to download...It's a exelent pack" and gives it a 10
the Violet guy simply removes the rating and puts a very stupid and inappropiate comment such as "WRONG. There is lots more to say. Rating removal. ~Violet" after it. That's very arrogant behaviour imho. The old guideline was, if someone rated a pack like Blade's with 1 while the pack had an average of 9,5 and wrote "this sucks" then the rating was removed by the admins.
You all know that i personally always wrote very long, very detailed and quite harsh reviews (average lenght: 704 characters, beat that), thats why i got a pretty good reputation at J2O if i remember right, but i can't accept these arrogant comments by the new admins, in this case Violet CLM.
As for me, i do not agree to these new kind of "guidelines" and i'm not sure if Fquist, Bobby, Iced, EvilMike, and Shadow, as the admins of old times, would agree to this.
P.S.:
mirrow, i dont get the point of your post.
MoonBlazE
Mar 29, 2004, 04:52 AM
I cannot understand why a part of the administration are spending their time moderating older reviews over the new ones. Olsen recently uploaded the same level twice with only minor changes, nothing has happened to his previous upload (Which should've been deleted by now).
Trafton and Violet are overdoing their job. I agree with we need some kind of moderating, but they are rather purging the site. One of the reasons I dislike uploading my work is specially because I hate the moderating of the site that is either rare or overdone.
It's pretty obviously that both of these administrators are doing this without having discussed it with the rest of the administration. Good thing ShadowGPW is mature enough to change back the ratings temporarily.
ShadowGPW
Mar 29, 2004, 04:59 AM
thats the reason when ML releases something we WONT upload it j2o because of this.
Stijn
Mar 29, 2004, 05:36 AM
Boycot... Strange, but I actually like that idea. There's always Haze's Hideout that has a level downloads section too.
Newspaz
Mar 29, 2004, 06:18 AM
In my opinion, if admins don't like undetailed reviews they should just delete them.
Aiko
Mar 29, 2004, 06:33 AM
I don't like boycot (J2O is the best download site, and always will be) and deleting (that's even more insolent) as alternatives either, sorry.
I only ask the new admins to treat reviewers with a tad more reserve and respect.
Stijn
Mar 29, 2004, 06:38 AM
It may be the best download site, but the main purpose of uploading files is (for me) to hear the opinions of others. If the admins keep deleting those, I will upload them somehwere were people can give their opinions without others editing them.
Newspaz
Mar 29, 2004, 06:47 AM
The edited reviews are frustrating. Although, I don't like short reviews either. That's why I say, get rid of it if it isn't right.
Ninja
Mar 29, 2004, 08:09 AM
(FTR)
Derby: Flame tag removal. Do not coax other users into attacking you.
Trafton
Mar 29, 2004, 09:55 AM
I don't remove ratings from older reviews unless someone complains about them. Rating standards have changed over time. I can't hold people accountable for reviews they made back when short reviews were okay. However, new reviews on older works I still look at.
As for filters, since bypassing them has ALWAYS been against J2O rules, I still remove them when I see them, regardless of age. However, I never give a warning for anything older than a month.
It was agreed to by all the administrators that we would be more strict with reviews. This applies to both packs that are loved and hated.
I have removed the ratings from the reviews Shadow restored - I would recommend against restoring these ratings to all tens without knowing if they were the original. That is no more fair than removing them.
I agree that reviews this old shouldn't be messed with. I'll bring this up in The Catacombs.
~ Traft
FQuist
Mar 29, 2004, 10:15 AM
Hi,
i just wanted to download some old elite battle packs such as Blade's Battle Pack Vol. 2, which can be found here: http://www.jazz2online.com/downloads/moreinfo.php?levelid=373
To my surprise and horror nearly all ratings were removed and a lot of pretty insolent and authotarian blabla was put there instead by some guy called Violet CLM.
Here are some quotes, and remember that we are talking about Blade's awesome second Battle pack:
"WRONG. There is lots more to say. Rating removal. ~Violet"
"Borderline, but not enough detail, too unsupported. Rating removal. ~Violet"
"This review is just unacceptable. Detail or don't rate. Rating removal. ~Violet"
I guess someone is going a bit too far here? Tsk...
What are you doing with our three year old(!!) download ratings? I didn't see you around back then...!? And what is this all about? What happened to my beloved Jazz2Online download section, where i did 534 reviews? Does Fquist know about this?? I'm asking for an explanation and or apology.
No, I did not know about this.
EDIT: and I apologise for not discovering this sooner and stopping it.
Nielsje
Mar 29, 2004, 10:46 AM
I think the administration system of J2O is just fine. It is necessary in my opinion tha writers of reviews give a decent explanation about WHY they gave such a rating.
Image yourself this: you created a wonderful level in JJ2, probably worth a 8.5 or higher, and some noob comes up and rates it around 2.0, just for fun, without any explanation. Conclusion: you download is ruined, just like all the work you;ve spent on it. No-one will ever see your level as a real good level I am. In order to prevent these crimes, I'm glad we have a administration at J2O.
Risp_old
Mar 29, 2004, 11:24 AM
It also keeps people from acting like I have seen on other sites, where people are like- 'it does not work for me. I give it a 1.'
I personally do not really care about old reviews. Sometimes they bug me (like one review of tomb rabbit that was just the author complaining about how much Kjero liked spikes), I generally don't care.
Violet CLM
Mar 29, 2004, 11:32 AM
Old reviews like that are no longer removed, and they have not been removed for months. Those are from when I was first made an admin. My job, as I was told, was primarily to remove "unsupported" ratingss. As the majority of reviews happened in the past, I assumed all unsupported reviews were fair game - after all, previous sweeps for bad reviews made in the past HAVE been made.
Trafton later noticed this. Despite general approval of removing the unsupported ratings on his part, he advised the removal of ratings prior to my appointment as Admin should cease, because if any single review from then was left unmoderated, it would show biasedness. And it has ceased. While there is no real way to find out what the ratings were on the long-ago unsupported reviews, you can rest assured no more old reviews will have their ratings removed without warning.
It remains true that rating something a long distance away from the average rating requires a longer review than one close to the average. But you STILL NEED TO BACK IT UP. These are the J2O RULES, which remain posted nowhere, but eventually we may be able to get them visible. Really, it only takes about twenty minutes to create even a very short acceptable review. If your rating gets removed, it is primarily YOUR FAULT.
In summary, yes, that happened. It was an accident. It will not happen again.
~Unknown Rabbit aka Violet CLM (in case this post didn't make sense to you)
FQuist
Mar 29, 2004, 11:55 AM
Not entirely true, Violet. The rules aren't as strict as you pursue them. See admin forum.
$tilettø
Mar 29, 2004, 12:13 PM
lol chippie.. if someone rates it low.. do you die or something? no? get a life?
imo as long as they explain what they think of it its fine.. but the way its now.. lmbo
Derby: Acronym clearance. Do not use offensive acronyms.
Derby
Mar 29, 2004, 12:56 PM
J2O is a site where users can review content with valid opinions. An opinion is never wrong. An opinion, however, is invalid if it has no support whatsoever.
That said, the quality of many of the reviews on J2O is excruciatingly dismal and the invalidity of the opinions disallows the respective reviews to warrant an actual rating.
Those who submit poor reviews have no excuse at all for posting poor reviews. He or she only has to ask him or herself a few questions and submit a minimum of three to five well-developed sentences to support his or her opinion.
The following is what one could ask him or herself to help justify his or her review:
1. If someone were to read my review, would he or she be able to determine that I have actually evaluated the content thoroughly?
2. Do I have a solid statement about the content?
3. Do I have sufficient evidence to support that statement?
4. Does my explanation for the evidence's correlation to the statement effectively support my conclusion about the content?
5. Is the statement in my review justified by the support? What can I add if it is not justified?
These questions are already integrated into various reviewers' thinking processes. If one finds his or her reviews constantly having his or her ratings removed, he or she better believe that he or she can strongly answer with "no" to one of the questions above.
Users really should not have to write too much about the content that they are reviewing because they have other things to do and cannot make the full-time commitment to J2O that some think they can. On the other hand, users should not be able to write off or praise another user's hard work with just a few unsupported statements. One would be right to say that opinions are never wrong, but he or she would be illogical to say that they are always valid.
I do not necessarily represent the views of J2O's administration or any of J2O's individual reviewers. In my opinion, the removal of older reviews' ratings was not a good idea because the general opinion had been established by many other reviews of the same content in the past; also, the users were not under the same magnitude of enforcement of the rules. However, J2O's administration has still been relatively lenient in the removal of ratings if one considers the fact that various monitored reviews would get negative responses with the questions above.
The writing of reviews does not have to be systematic, but the enforcement of the rules does. This issue is nowhere near as big as it has been made out to be, but it does need to be addressed more systematically.
Lark
Mar 29, 2004, 12:59 PM
I think that J2O should still enforce removing undetailed reviews, but the amount of reviews that get removed seems to be a bit too high now, and when I saw that a lot of the reviews on levels such as Heaven were removed, I was extremely angry. Levels that old should be left alone. I also have noticed that even admins wrote reviews that were too short for todays standards back then. But none of them were removed.
Having reviewed a lot before Violet became an admin, and also having the third most reviews of anyone on J2O, and a relatively low amount of them removed, I say that the amount of reviews removed should be somewhere between the amount Trafton removed when Violet wasn't an admin and when Violet first became an admin.
Or something. (I love putting, "Or something," at the end of my replies and posts).
Edit: Read Derby's post immediately. I agree with him fully. *worships*
Ninja
Mar 29, 2004, 01:16 PM
(FTR)
Derby: Flame tag removal. Do not coax other users into attacking you.
<I know you can see what was said in the past. :)>
MaGoo
Mar 29, 2004, 02:05 PM
I think a good way to help remove unsupported ratings is to get rid of the J2O ranking system all together. I have been noticing that many people do things (such as rate levels) just to get these better rankings. To me, it's really no different than having forum post counts and a ranking system under your username and location. An unsupported rating is just spam. Get rid of the ranking system!
ShadowGPW
Mar 29, 2004, 02:24 PM
got demoted after my comment about lies ;)
Blackraptor
Mar 29, 2004, 02:59 PM
Yeah. Same here, I read through some old reviews of levels like Heaven and got seriously (mad). And when I first joined, I thought the original rules of rating levels was to make sure your rating is fair (i.e. not rating a 9 rated levelpack 5 for no reason), but the content of your review could be pretty short (as long as it somehow indified that you downloaded the level). Anyways, glad its over.
Derby: Content replacement. A filtered expression was simply replaced because it had a less offensive alternative.
Trafton
Mar 29, 2004, 03:28 PM
Before this turns into a flame-grilled BBQ, all the ratings that can be (that should be most of them) are being restored by Bob, who now should be bowed down to. <b><i>NOW!!!</b></i>
So, contrary to popular belief, J2O administrators are not heartless, hateful, fire-breathing demons who never listen. We're heartless, hateful, fire-breathing demons who <i>do</i> listen!
User feedback is always appreciated. We value your business. You are the next caller.
~ Traft
Radium
Mar 29, 2004, 04:14 PM
Happy dance! =D
Radium
Mar 29, 2004, 04:59 PM
I believe there should be some sort of selection when uploading a level as to the strictness of it's review moderation. It would be something that only moderators could see and would be taken into account while being moderated. I believe that if an author wants his/her level to be moderatedly strictly, loosely, or not at all (Possibly more options) then it should be. I'm not sure how hard this would be to implement but I think it would be useful to moderators. It would also prevent people from being discouraged to upload their levels to J2O. And it would help moderators from being blamed (As long as they follow the authors choice) when they were doing their job, or what they believed to be their job.
Yay, I'll select "no moderation" and rate my level a 10.
Bobby aka Dizzy
Mar 29, 2004, 05:58 PM
We'll be going through about 135 old reviews and putting the old ratings back in place where we feel it is necessary. I found a backup of the reviews from June 2003 and I believe that it should cover most retroactive edits. If this does not suffice I'm sure we can find an earlier backup. Hopefully everything should be fixed in a day or two.
Monolith
Mar 29, 2004, 07:06 PM
I'm not sure what's in the works for J2Ov2, but I would sort of like to see some sort of filtering system used rather than just completely deleting stuff. Filtered items (reviews or whatever) might normally not be displayed used for calculations, but they would still be viewable to normal users. At least something like that would seem a little nicer to me than completely destroying the original content.
$tilettø
Mar 29, 2004, 10:14 PM
got demoted after my comment about lies ;)
so when you say something about them you get demoted.. ? but they can edit everything you do.. and say stuff ?? o_0 seems like you didnt had any power anyway..
nm..
FQuist
Mar 30, 2004, 02:43 AM
It lies more complicated than that, Stilletto. Please do accept that the judgement was fair in our opinion.
ShadowGPW
Mar 30, 2004, 04:49 AM
It lies more complicated than that, Stilletto. Please do accept that the judgement was fair in our opinion.
For you perhaps :)
He doesn't want to hear the voice by his crew aswell. BUt thats okey. It's his site afterall.
$tilettø
Mar 30, 2004, 05:08 AM
Well, Fquist.. as i see it Trafton has all the power.. if he wants something.. like Shadow getting demined ( they oftenly didnt agree.. this is a reason ) and in all these years shadow hardly did anything wrong.. and he didnt change j20 by making this stupid rulez editing like almost everything..
but i dunno what happens behind the "" schermen"" so thats nm.. :p
FQuist
Mar 30, 2004, 05:46 AM
And that's exactly what it is about, Stilletto. "Achter de schermen". The things you don't see. You do not know the rationale behind the decision and I owe no responsibility for an explaination to anyone here, including you.
And that about Trafton having the ultimate power is nonsense. He had nothing to do with Shadow being demoted and he has no ultimate power at all. That power lies with me and Bobby.
I do not feel to speak any more of this. It's an internal affair and I am not going to argue about it. I will only say that I stand behind my decision, it was made for good reason, and Bobby stands behind it as well. Trafton had nothing to do with it. And I will say that I do listen to the crew and that the demotion had nothing to do with not listening to the crew.
Now may I suggest we return to the topic?
Blaze The Movie Fan
Mar 30, 2004, 06:18 AM
Hi,
i just wanted to download some old elite battle packs such as Blade's Battle Pack Vol. 2, which can be found here: http://www.jazz2online.com/downloads/moreinfo.php?levelid=373
To my surprise and horror nearly all ratings were removed and a lot of pretty insolent and authotarian blabla was put there instead by some guy called Violet CLM.
Here are some quotes, and remember that we are talking about Blade's awesome second Battle pack:
"WRONG. There is lots more to say. Rating removal. ~Violet"
"Borderline, but not enough detail, too unsupported. Rating removal. ~Violet"
"This review is just unacceptable. Detail or don't rate. Rating removal. ~Violet"
I guess someone is going a bit too far here? Tsk...
What are you doing with our three year old(!!) download ratings? I didn't see you around back then...!? And what is this all about? What happened to my beloved Jazz2Online download section, where i did 534 reviews? Does Fquist know about this?? I'm asking for an explanation and or apology.
The reviews were too short, and that's illegal! Please have longer review and it won't happens, I promise! ;-)
ShadowGPW
Mar 30, 2004, 06:21 AM
The reviews were too short, and that's illegal! Please have longer review and it won't happens, I promise! ;-)
haha, its not about you bud :)
FQuist
Mar 30, 2004, 07:00 AM
J2O is a site where users can review content with valid opinions. An opinion is never wrong. An opinion, however, is invalid if it has no support whatsoever.
That said, the quality of many of the reviews on J2O is excruciatingly dismal and the invalidity of the opinions disallows the respective reviews to warrant an actual rating.
Those who submit poor reviews have no excuse at all for posting poor reviews. He or she only has to ask him or herself a few questions and submit a minimum of three to five well-developed sentences to support his or her opinion.
The following is what one could ask him or herself to help justify his or her review:
1. If someone were to read my review, would he or she be able to determine that I have actually evaluated the content thoroughly?
2. Do I have a solid statement about the content?
3. Do I have sufficient evidence to support that statement?
4. Does my explanation for the evidence's correlation to the statement effectively support my conclusion about the content?
5. Is the statement in my review justified by the support? What can I add if it is not justified?
These questions are already integrated into various reviewers' thinking processes. If one finds his or her reviews constantly having his or her ratings removed, he or she better believe that he or she can strongly answer with "no" to one of the questions above.
Users really should not have to write too much about the content that they are reviewing because they have other things to do and cannot make the full-time commitment to J2O that some think they can. On the other hand, users should not be able to write off or praise another user's hard work with just a few unsupported statements. One would be right to say that opinions are never wrong, but he or she would be illogical to say that they are always valid.
I do not necessarily represent the views of J2O's administration or any of J2O's individual reviewers. In my opinion, the removal of older reviews' ratings was not a good idea because the general opinion had been established by many other reviews of the same content in the past; also, the users were not under the same magnitude of enforcement of the rules. However, J2O's administration has still been relatively lenient in the removal of ratings if one considers the fact that various monitored reviews would get negative responses with the questions above.
The writing of reviews does not have to be systematic, but the enforcement of the rules does. This issue is nowhere near as big as it has been made out to be, but it does need to be addressed more systematically.
I do not agree with this post at all. On the contrary.
You've got a nice argument but it is only valid if the point of the site is just rating levels instead of a <i>community</i> site. Yes, so many reviews are not really helpful. They don't have to be in my opinion, that's only what we prefer, but it's not compulsory. The site is not just for the creators of levels, it's for the reviewers, too.
It's like a restaurant. The admins are the owners. Now, they could have this policy where everyone who wants to eat in the restaurant has to wear very shiny and high-quality clothes, but that way the restaurant would become so formal they would barely get guests, because some people just don't like that. So what they (we), the admins, should do is allow in people without a nice tie, too. That doesn't mean they should let in people who wear rags.
Obviously <i>some</i> reason has to be given when reviewing a level. But "I really like this levels' graphics and gameplay." is good enough in my opinion. Only things like "Wow this rocks!!" should be disallowed. And even then you can pm the owner asking him to improve it before dumping it.
If you disallow smaller opinions people will go away. Who can blame them.
"J2O is a site where users can review content with valid opinions. An opinion is never wrong. An opinion, however, is invalid if it has no support whatsoever."
Indeed an opinion is never wrong. Neither is it invalid. It's just that, when that opinion is expressed people will give it more value if the opinion is supported by arguments. But some opinions are invalid for our site.
If an opinion differs a lot from the majority and has not enough supporting arguments, then we will have to doubt it's veracity. It's still a valid opinion in itself, but we have to see then if it has any value to keep. If it really is badly supported, like someone rating a level with a 1 because it is giving a 404, then actions should be taken.
"That said, the quality of many of the reviews on J2O is excruciatingly dismal and the invalidity of the opinions disallows the respective reviews to warrant an actual rating."
Bad quality disallows giving a rating? That's not something I agree with. See my restaurant analogy.
"Those who submit poor reviews have no excuse at all for posting poor reviews. He or she only has to ask him or herself a few questions and submit a minimum of three to five well-developed sentences to support his or her opinion."
They have an excuse. They're allowed to. It's that simple. We are not a proffesional site. We are not peer reviewers, scientists, teachers, whatever. We have a community site dedicated to a game. One inhabited by very young people, most of which who have english as a second language. That doesn't mean we can't try and push them to improve, but to just shut all their comments down is harsh. There're better ways for that. Still, it's allowed.
Why should we raise the bar as high as you suggest?
Our admin policy should be that when your rating really differs from the rest of the ratings people gave you will really have to have a good argument. But if it's the same, no, reviews don't have to be <i>that</i> detailed. The positive effects of this, more reviews, will outweigh the negative because more opinions (other than 'wow!' and 'cool!') will give a better average.
I value free speech here above having each review here really good. And it is in my mind that this will stay. I've made up my mind and I don't think my opinion of this will change..
FQuist
Mar 30, 2004, 07:02 AM
<b>Summary:</b>
I value freedom of speech on our site and having lots of reviews and a community more than having only great-quality reviews. We have to remind ourselves this is a game and a site for young people, most of which speak english only as a second language. It's not an encyclopedia which we need peer review for and very high quality.
This is admin policy and should be kept that way.
Stijn
Mar 30, 2004, 07:11 AM
That's exactly my opinion. *cheers loudly*
Derby
Mar 30, 2004, 09:41 AM
You've got a nice argument but it is only valid if the point of the site is just rating levels instead of a <i>community</i> site. Yes, so many reviews are not really helpful. They don't have to be in my opinion, that's only what we prefer, but it's not compulsory. The site is not just for the creators of levels, it's for the reviewers, too.
Actually, the argument is only valid if the point of the site is reviewing levels, not just rating them. I will address this issue of our views of the site just a bit later.
It's like a restaurant. The admins are the owners. Now, they could have this policy where everyone who wants to eat in the restaurant has to wear very shiny and high-quality clothes, but that way the restaurant would become so formal they would barely get guests, because some people just don't like that. So what we, the admins, should do is allow in people without a nice tie, too. That doesn't mean they will let in people who wear rags.
In the world of the analogy you describe, anyone could have shiny and high-quality clothes materialize right on them using only basic reasoning and a little extra time; that is, if the analogy fits the situation here. It is not my idea to moderate reviews, but just following that idea, it needs to be looser. You would decide how loose it is.
Obviously <i>some</i> reason has to be given when reviewing a level. But "I really like this levels' graphics and gameplay." is good enough in my opinion. Only things like "Wow this rocks!!" should be disallowed. And even then you can pm the owner asking him to improve it before dumping it.
If you disallow smaller opinions people will go away. Who can blame them.
No; saying "I like this level's graphics and gameplay" is no more helpful than simply giving it a high rating. Anyone can tell that the graphics and gameplay of a level are decent when the level is rated a 9 out of 10. Calling this reviewing the level is absolutely illogical because it shows absolutely no effort to review it or evidence that it was reviewed. I do not review or even rate levels often because I even have an opinion of the level; I just do not have the time to post even a small opinion, and so I leave. The review system should not be completely discarded like this just because it is a little beaten up and unappealing to a few.
Indeed an opinion is never wrong. Neither is it invalid. It's just that, when that opinion is expressed people will give it more value if the opinion is supported by arguments. But some opinions are invalid for our site.
An opinion is invalid if it has no support. There are many invalid opinions on J2O, because the users only rate the levels and review them with an equally redundant compilation of text.
If an opinion differs a lot from the majority and has not enough supporting arguments, then we will have to doubt it's veracity. It's still a valid opinion in itself, but we have to see then if it has any value to keep. If it really is badly supported, like someone rating a level with a 1 because it is giving a 404, then actions should be taken.
If you start out with an invalid opinion, a chain of invalid opinions with a small variance can easily invalidate a valid opinion if it differs a lot from the majority. This system alone is inaccurate and ineffective.
Bad quality disallows giving a rating? That's not something I agree with. See my restaurant analogy.
Your restaurant analogy works with simply rating levels. What I described is what was happening just a while ago where users had to review the levels. There is a very big difference.
"Those who submit poor reviews have no excuse at all for posting poor reviews. He or she only has to ask him or herself a few questions and submit a minimum of three to five well-developed sentences to support his or her opinion."
They have an excuse. They're allowed to. It's that simple. We are not a proffesional site. We are not peer reviewers, scientists, teachers, whatever. We have a community site dedicated to a game. One inhabited by very young people, most of which who have english as a second language. That doesn't mean we can't try and push them to improve, but to just shut all their comments down is harsh. There're better ways for that. Still, it's allowed.
They have an excuse because they are allowed to, and because you allow them to. Basic reasoning has nothing to do with what language one speaks.
Why should we raise the bar as high as you suggest?
Our admin policy should be that when your rating really differs from the rest of the ratings people gave you will really have to have a good argument. But if it's the same, no, reviews don't have to be <i>that</i> detailed. The positive effects of this, more reviews, will outweigh the negative because more opinions (other than 'wow!' and 'cool!') will give a better average.
I value free speech here above having each review here really good. And it is in my mind that this will stay. I've made up my mind and I don't think my opinion of this will change..
The reason I suggested what I suggested was because I was misled by the fact that the link to the "reviews" section reads "reviews." You have a vision of J2O where users rate levels with short comments that cannot logically be considered reviews because they show no evidence of review.
Am I suggesting that you should change the link to say "ratings" instead of "reviews?" Of course not. My vision is different from yours for a reason. For one, I truly believe that better reviews will result in a higher quality in production of levels. If users do not have reviewers' valid opinions to make improvements on their levels, they can only copy off other good levels and hardly come up with anything innovate or remotely good. In my personal opinion, I find a database of good content with some reviews far superior to a database of bad content with a plethora of ratings.
You value free speech, and that is fine. However, by having J2O up in the first place, you imply that you value the community's prosperity and progress. You certainly have the propserity down with the free speech part, but you cannot say that there will be any progress with this "rating" system.
I am not suggesting a radical idea to make everyone think like high-class people with shiny clothing. I am suggesting that users should actually review the content than give their overall opinion of it, so the content increases in quality. Reviews do not have to be long; they can always be a few sentences. In fact, they do not at all have to discuss every single aspect of the content.
The way you want to run J2O is up to you, and I do not plan to influence or change it. I just want to let you know that prosperity of the community is not the important aspect of the community. What you value is different from what I value, and so our views of J2O differ proportionally.
Trafton
Mar 30, 2004, 10:15 AM
Well, Fquist.. as i see it Trafton has all the power.. if he wants something.. like Shadow getting demined ( they oftenly didnt agree.. this is a reason ) and in all these years shadow hardly did anything wrong.. and he didnt change j20 by making this stupid rulez editing like almost everything..
but i dunno what happens behind the "" schermen"" so thats nm.. :p
Although FQuist already replied to this and basically said it all, I feel that I should say it for myself, as well. Sorry for the following sounding cheesy or mechanical, but I'm a bit preoccupied at the moment.
I really do not have much power. The main thing I do is enforce rules already in place and try, when I get a chance, to convey suggestions that have gained popularity on the JCF. I may have opinions, but I do my best not to introduce them into administrating.
I had nothing to do with Shadow getting "deadminned," even if I did disagree with him. Although I may do so, I would not ban him. It isn't my job to ban those who I disagree with. The very thing that supports any good democracy (or dictatorship, in this case) is differing opinions. Why should Shadow's opinions be held in less regard than mine? Why should I deadmin him just because I disagree with him? What sort of fun would there be in winning a disagreement by preventing someone from being in it? Even if I wanted to deadmin him or whatever, it is not my call. Bob and FQuist are the only ones who should do it, and my job is to enforce their rules, and nothing more.
Heck, I do not even know the reason for which Shadow was "deadminned," and really don't care. It has nothing to do with me and is honestly not my business.
~ Traft
FQuist
Mar 30, 2004, 11:14 AM
"The review system should not be completely discarded like this just because it is a little beaten up and unappealing to a few."
Where did I propose that it should be discarded? Nowhere did I say that.
Rather, I am proposing that we keep the review-moderating system as it has been since the start of our site, with the exception of editing the <i>really</i> short stuff. How is this completely discarding the review system? It's keeping it as it is!
And it's not just unappealing 'to a few'.
"In the world of the analogy you describe, anyone could have shiny and high-quality clothes materialize right on them using only basic reasoning and a little extra time; that is, if the analogy fits the situation here. It is not my idea to moderate reviews, but just following that idea, it needs to be looser. You would decide how loose it is."
That's really not true. Not everyone is like you, Aiko, Trafton and the other good reviewers. Not everyone speaks english as well as you. Not everybody is as good at writing. Not everybody has the right mindset for it. Not everybody is as old. You're asking a lot of people. No, those ties can't just be materialised. And if we want them to be there there are other ways to purchase them than just editing everything. Like advice and other ways.
Even for me, someone older than most of the users on J2o, writing even medium reviews is quite hard. It's not just "a little extra time" and "using only basic reasoning". This does not mean it's good to have bad reviews, but what you say here is wrong.
"If you start out with an invalid opinion, a chain of invalid opinions with a small variance can easily invalidate a valid opinion if it differs a lot from the majority. This system alone is inaccurate and ineffective."
This has never happened on J2O and there is no reason to think why it would suddenly start happening.
"The reason I suggested what I suggested was because I was misled by the fact that the link to the "reviews" section reads "reviews." You have a vision of J2O where users rate levels with short comments that cannot logically be considered reviews because they show no evidence of review."
No, I haven't. Please read my post. I never ever proposed getting rid of longer reviews altogether. I never even proposed discouraging them. In fact, I'm only countering the people who think we should be much more authoritarian about it, instead of just using normal ways of helping the community get better.
"You value free speech, and that is fine. However, by having J2O up in the first place, you imply that you value the community's prosperity and progress. You certainly have the propserity down with the free speech part, but you cannot say that there will be any progress with this "rating" system."
Where I and you differ is not in how we perceive the downloads section but how we perceive the use of power. I prefer using other methods than power to improve the downloads section. You prefer having strict quality control.
ShadowGPW
Mar 30, 2004, 11:22 AM
SO MUCH TEXT.
Erm you guys haven't got pain in the fingers yet?
offtopic: wouldn't be A_LOT more easier to have a review team of people ? But still let users allow to comment on it.
Or make a splitted. - User rating, crew rating
Derby
Mar 30, 2004, 11:37 AM
Where did I propose that it should be discarded? Nowhere did I say that.
Rather, I am proposing that we keep the review-moderating system as it has been since the start of our site, with the exception of editing the <i>really</i> short stuff. How is this completely discarding the review system? It's keeping it as it is!
And it's not just unappealing 'to a few'.
If "This has great eyecandy and gameplay, I rate it a 9" is what it takes to be a review, then it was primarily a rating system all along. Keeping it as it is happens to be keeping a rating system, because that is all it apparently takes to constitute a "review." So maybe it was never discarded; it was never there to begin with.
That's really not true. Not everyone is like you, Aiko, Trafton and the other good reviewers. Not everyone speaks english as well as you. Not everybody is as good at writing. Not everybody has the right mindset for it. Not everybody is as old. You're asking a lot of people. No, those ties can't just be materialised. And if we want them to be there there are other ways to purchase them than just editing everything. Like advice and other ways.
Even for me, someone older than most of the users on J2o, writing even medium reviews is quite hard. It's not just "a little extra time" and "using only basic reasoning". This does not mean it's good to have bad reviews, but what you say here is wrong.
I personally feel that moderation should have no correlation with the ability to compose English sentences; this is a factor that the administration can control. That said, actually viewing the content should take most of the time, and then a short justified review can be submitted. What is being requested here is not longer reviews, just more justified reviews. I personally do not see a restatement of the rating to be remotely acceptable. Nobody learns anything from the review, and above all, the creator learns nothing.
"If you start out with an invalid opinion, a chain of invalid opinions with a small variance can easily invalidate a valid opinion if it differs a lot from the majority. This system alone is inaccurate and ineffective."
This has never happened on J2O and there is no reason to think why it would suddenly start happening.
Actually, it happens all the time. A user's first review will indefinitely influence the reviews around it, and that is one fact that cannot be argued. This is also empirically true of many reviews submitted on content prior to heavier moderation. I speculate that if it happened in the past, it will happen again.
"The reason I suggested what I suggested was because I was misled by the fact that the link to the "reviews" section reads "reviews." You have a vision of J2O where users rate levels with short comments that cannot logically be considered reviews because they show no evidence of review."
No, I haven't. Please read my post. I never ever proposed getting rid of longer reviews altogether. I never even proposed discouraging them. In fact, I'm only countering the people who think we should be much more authoritarian about it, instead of just using normal ways of helping the community get better.
Again, reviews have empirically shortened and lost quality. With this result, reviews resemble ratings with restatements of ratings rather than just reviews. It does not matter whether you encourage or discourage long reviews, as long as poor reviews can be made, they will be made. As a result of their materialization, poor reviews will bring poor reviews, and nothing will have been learned. This works both in theory and empirically.
Where I and you differ is not in how we perceive the downloads section but how we perceive the use of power. I prefer using other methods than power to improve the downloads section. You prefer having strict quality control.
I certainly prefer having quality control, but it is nowhere near as strict as you perceive it to be. Even an attempt to justify a review would be understandable, in my opinion. There is no point to having many people enjoying absolutely nothing, and there is no point to having no people enjoying a lot. A balance is necessary here, and that balance cannot be achieved without some sort of quality control. Progress is just as important as prosperity, and having just one or the other is not acceptable.
Trafton
Mar 30, 2004, 12:06 PM
SO MUCH TEXT.
Erm you guys haven't got pain in the fingers yet?
offtopic: wouldn't be A_LOT more easier to have a review team of people ? But still let users allow to comment on it.
Or make a splitted. - User rating, crew rating
How would the "crew" be chosen? It is unfair to have the overall rating affected strongly by a small number of people. Administrators should not be in the position to decide between different candidates and reject them; bias is too easily entered into the equation, among other things.
~ Traft
FQuist
Mar 30, 2004, 12:09 PM
I do not feel like responding with another half essay-length reply. I feel I've argued my case.
You discovered what the rating system has always been, Derby. Yes indeed it has always been like that. That quality is bad at the moment is not due to a lack of quality control but due to a lack of the right people.
And stop putting quote around review, Derby. It's just what it is called, which is similar to thousands of other sites, including amazon, who also have one-line comments.
We SHOULD have quality control. But just not so authoritarian. Quality control is more than indiscriminately editing user's reviews. Progress isn't necesarrily caused by power.
FQuist
Mar 30, 2004, 12:09 PM
I just don't understand the whole fuss about this. Is this a surprise or anything? It's <b><i>always</i></b> been like this. Our downloads section has never been of bad quality until now. Has this come due to our policy? No, it is because lots of good people don't review at the moment.
Aiko
Mar 30, 2004, 12:14 PM
Oh boy, what have i done :-)
I just want one more thing to add, esspecially to the American admins around Derby, Trafton and Violet: your rhetoric and english skills are very good, and i personally cant compete with that (not that i have the time :), but...i would ask you to take all this a bit more easy...this is not science, war or peace or something, but just some kiddie 2d platformer.
Just be a bit more leniant with us people in the forums and in the downloads and please don't edit, comment and censor so much :)
P.S.:
I agree with Fquist on most points here.
Violet CLM
Mar 30, 2004, 12:20 PM
Those are not "reviews" on Amazon. Those are the half second works of drunk people.
...in truth, the average review quality these days is a LOT higher than it was back in the early days of J2O. Many of the people who post good reviews on a regular basis, in fact, used to have quite poor average review quality. If we allow short, unsupported things, the users will NOT improve.
...English as a first language is not required. Even Bjarni can post good reviews. Especially because he really cares about J2O and what happens there.
Blaze The Movie Fan
Mar 30, 2004, 12:23 PM
Those are not "reviews" on Amazon. Those are the half second works of drunk people.
...in truth, the average review quality these days is a LOT higher than it was back in the early days of J2O. Many of the people who post good reviews on a regular basis, in fact, used to have quite poor average review quality. If we allow short, unsupported things, the users will NOT improve.
...English as a first language is not required. Even Bjarni can post good reviews. Especially because he really cares about J2O and what happens there.
Lol, that's true! My reviews are really long!
FQuist
Mar 30, 2004, 01:15 PM
"If we allow short, unsupported things, the users will NOT improve."
Soft power vs. Hard power fallacy. That we allow it doesn't mean we actively support short things. We can still work on improvement. It just means we don't automatically edit everything out that's just a little bit too generic. It means PMing the user instead, giving a good example, rewarding good reviews, etcetera etcetera.
MoonBlazE
Mar 30, 2004, 03:01 PM
If we allow short, unsupported things, the users will NOT improve.People's not going to follow this kind of evolution, enforcing it will only result in people not wanting to post their review or simply stop uploading to the dictory. You already have two examples: Aiku who deleted his review and Flash who uploaded his pack to the forum instead.
You have to accept people just wanna voice their opinion, either by content or rating. They want to have fun together. I do not upload my work for a 30 pages essay explaining me my own work, I upload it for feedback given by other community members. By editing ratings you are editing a part of their opinion, which is what we, the level authors, are intersted in.
I'd want to express myself better but I'm way too sleepy right now.
Derby: Previous quotation edit. You quoted one user and applied a different username for the quote; this was probably an accident.
Chiyu
Mar 31, 2004, 12:59 AM
I'll have to agree with most of the people here. I think I saw the same upload that Aiko saw, about 80% of the ratings were removed, only one rating remained. This is really going too far :|.
Violet CLM
Mar 31, 2004, 01:39 AM
Yes, but have you read the topic? Assuming I know what upload you're talking about, that was a mistake, and is being fixed.
Stijn
Mar 31, 2004, 07:06 AM
Atleast it appears to be to me. Not uploading to a site because they edit out short reviews which don't help the author seems like their overreacting to me.
Sorry, but "nice eyecandy and gameplay" does help me actually. Until now my levels were usually levels that had a pretty bad gameplay, so that review would tell me I actually achieved my goal, which was creating levels with decent gameplay.
And unlike most of you (at least it appears that's the case) I find a "nice work, you really made a few good levels" nicer than a 2000-character review with the boring standard pros/cons layout. It's almost looking like they are computer-generated.
Blackraptor
Mar 31, 2004, 01:36 PM
Imho, a review can be short, but it should help the level author in some way. Saying "this is great level, eyecandy and gameplay is good! 9!" does not help the maker of the level in any way. How is the eyecandy good? How can it be improved? What are the level's strong points and what should be taken out? It just takes a few sentences to write this. People can at least try.
J2O is a community site, and people should have the freedom to rate things how they feel as long as there is some proof they actually played and evaluated the level. It could be as short as "The level is good, but next time you can use more ramps for smoother play, and less leaves in the foreground to distract you from whats going on."
Also, I sort of disagree on only editing short, pointless reviews with a rating too high/too low. If a user says "Great level! You get 8.5!" to a level rated 8.5 or so, it should get the same treatment if that review was said about a level averaging a 6, since in both reviews it doesn't give any notice whatsover that the reviewer even downloaded the level.
Of course, short revies are allowed and can help people, and there is no real rule to how long a review should be. It's really the reviewer's choice.
Well, that's my opinion. Feel free to criticize it.
Violet CLM
Mar 31, 2004, 02:30 PM
"Good" news, everyone! All the ratings on those old reviews have been restored. Your favorite J2O Admins have personally gone through and restored ratings to countless reviews (which mostly qualified for "worst review ever" contests)! Be happy! It won't happen again!
Stijn
Apr 1, 2004, 03:39 AM
Imho, a review can be short, but it should help the level author in some way. Saying "this is great level, eyecandy and gameplay is good! 9!" does not help the maker of the level in any way. How is the eyecandy good? How can it be improved? What are the level's strong points and what should be taken out? It just takes a few sentences to write this. People can at least try.
I suppose you didn't read the post above yours :P
KRSplat
Apr 1, 2004, 06:53 PM
"Good" news, everyone! All the ratings on those old reviews have been restored. Your favorite J2O Admins have personally gone through and restored ratings to countless reviews (which mostly qualified for "worst review ever" contests)! Be happy! It won't happen again!
The quotes around the word good are funny. 9/10
I think that the reason review quality is down is that not many people care anymore. The two reviewers notorious for posting extremely long reviews are now moderators which I guess is taking up their time, or maybe they just don't care. Frankly, I don't review anymore. I never really was a "great" reviewer anyway.
Violet CLM
Apr 1, 2004, 06:56 PM
Being an Admin is usually not very time consuming. <strike>Unlike J2Ov2.</strike> I don't know about Trafton, but I review less and smaller mainly because I don't care so much about JJ2 as I used to.
...I stand by what I've always said, the average review quality these days is better than it was when J2O began.
Blackraptor
Apr 3, 2004, 02:42 PM
Imho, a review can be short, but it should help the level author in some way. Saying "this is great level, eyecandy and gameplay is good! 9!" does not help the maker of the level in any way. How is the eyecandy good? How can it be improved? What are the level's strong points and what should be taken out? It just takes a few sentences to write this. People can at least try.
I suppose you didn't read the post above yours :P
Of course, short revies are allowed and can help people , and there is no real rule to how long a review should be. It's really the reviewer's choice.
*cough*
EvilMike
Apr 3, 2004, 05:49 PM
I read some posts and I have come to one conclusion: this is moronic. I'm not uploading any more of my levels to j2o. Not like I have done that for some time anyway.
All you'll see from me now is stuff contained in level packs. If I wind up finishing any.
[edit]
Just to clarify, I am talking about BOTH sides of the arguement here, in case any of you think I am on your sides.
The fact that old reviews are being edited by these overly obsessive "admins" who obviously take their jobs too seriously is one thing, but the fact that this spawned two pages of this bull is just embarrassing.
It's stuff like this which keeps people from playing jj2.
I'm not holding my work from being uploaded because I want to "teach you a lesson" in case any of you feel the need to jump to conclusions. To be frank, I just don't like to associate myself with this kind of website.
The same goes with how the JCF is run these days.
vBulletin® v3.8.2, Copyright ©2000-2025, Jelsoft Enterprises Ltd.