Sins of a Solar Empire : Real-Time Strategy. Unrivalled Scale.
© 2003-2013 Ironclad Games Corporation Vancouver, BC. All rights reserved.
© 2006-2013 Stardock Entertainment

Quick guide on beta testing Sins

By on July 24, 2008 11:28:49 AM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

Annatar11

Join Date 11/2006
+527

This won't really be new for those who know how software testing goes or who've beta tested Sins, but for everyone else I figured I'd write up a quick rundown on how Sins testing works so that Ironclad can get stuff done

The main principle to remember is that when you're reporting a bug or issue, you want to provide as much information is possible. In the case of bugs, if you can find a fix it usually helps quite a bit to determine the cause.

To post a bug:

Please create a new thread. In the past, Ironclad liked a separate thread for each specific bug, as they go through them and comment/edit the thread title with "Resolved" for issues they identified and fixed. It makes it easier for them than having to keep track of a single thread with many reports.

 

Basic game bugs:

Try to duplicate it. Try to figure out exactly how it happens, and you might just stumble on a "fix" yourself. This will pin it down for Ironclad so they know exactly where to look.

Example - There was once a bug where the colony/scouts "Capture neutral mine" ability had a bugged auto-cast. You could jump the ship in, turn on auto-cast and it wouldn't do anything. It turns out, the auto-cast was trying to look in the "local area" engagement range, even though the ship was set to "gravity well". This is how the bug was reported, and IC knew exactly where to look. If it was reported just as "Auto-cast of the capture neutral mine doesn't work", they would've had to try to discover it themselves, and would've wasted a lot more time.

Ship/AI behaviors:

This is the trickiest one because it's usually not easy to duplicate. When you see something funky happening with the AI or your ships: SAVE YOUR GAME. This is very important. When you write up your report post, host the save game on something like Rapidshare and include a link. Being able to see what you're talking about right away helps Ironclad a ton, because they can analyze exactly what the AI is trying to do at that moment.

Example - One of the most difficult bugs to squash for Sins was that ships would sometimes try to fly out of gravity well one normal drives instead of phase jumping. There was no sure-fire way to cause it, so you basically had to get lucky and see it. Ironclad could not track it down until we started submitting save games while it was happening, and they could see it in the act and analyze the code.

If you can't get a save game (forgot to save it, or whatnot), post the replay and indicate what time index to look at and where. They can't fast-forward replays either, so they have to look at 'em from the beginning, so knowing the when and where to look speeds up the process. Replays aren't usually as good as saves, but definitely better than nothing.

Graphics glitches:

Perhaps the easiest - just take a screenshot, and post it with your system specs Self explanatory here.

---

Beta testing is a cooperation between the testers and the developers. The more we dig in and figure out, the faster they can fix it. So, dig away! When the beta patch rolls out and if you start encountering issues, try to make your reports as detailed as possible, and let's not make the test phase take 2 months

 

Pinned Post   |   37 Replies
Search this post
Subscription Options


Reason for Karma (Optional)
Successfully updated karma reason!
December 17, 2008 12:58:52 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

I just got my first minidump, ever. What should i do with it?

Reason for Karma (Optional)
Successfully updated karma reason!
December 17, 2008 1:14:12 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

Send Entrenchment minidump files to support@ironcladgames.com with any details you can provide about what was happening at the time.

Reason for Karma (Optional)
Successfully updated karma reason!
December 17, 2008 9:16:29 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

yup, I've got the save file, and everything, I'll have it all up in a little while, thanks

Reason for Karma (Optional)
Successfully updated karma reason!
December 17, 2008 9:39:55 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

I posted save games and screenshots a couple of hours ago about this problem (ships leaving gravity well). The question: Do you need to upload the .stats files as well as the .saves for them to be useful?

Thanks!

Reason for Karma (Optional)
Successfully updated karma reason!
December 17, 2008 9:55:32 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

IDK, just got my stuff up, probly should've posted with you...oops. I just hosted the file on rapidshare, that way anyone with the game can check it out, I also posted what time, and where the occurrences took place

edit*

the .saves that is, that's all I posted

Reason for Karma (Optional)
Successfully updated karma reason!
December 18, 2008 12:05:01 AM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

Has anyone considered a central thread with a very basic explanation of the reported bugs so people stop reporting the same bugs five times? The TEC minefield price bug as well as the starbase graphical glitches come to mind when I post this.

Reason for Karma (Optional)
Successfully updated karma reason!
December 18, 2008 6:55:23 AM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

Quoting Blurt05,
I posted save games and screenshots a couple of hours ago about this problem (ships leaving gravity well). The question: Do you need to upload the .stats files as well as the .saves for them to be useful?

Thanks!

Don't need the stats, the .save file is just fine Stats is just for the end-game graphs and stuff, and I think it rebuilds them from the save anyway if it needs to.

Has anyone considered a central thread with a very basic explanation of the reported bugs so people stop reporting the same bugs five times?

I poked the officials about it for previous betas, but the general consensus was that nobody would read it anyway so it wouldn't reduce the forum noise much

Reason for Karma (Optional)
Successfully updated karma reason!
December 18, 2008 6:09:53 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

Quoting Annatar11,
I poked the officials about it for previous betas, but the general consensus was that nobody would read it anyway so it wouldn't reduce the forum noise much

This is probably true now that I think of it...

Reason for Karma (Optional)
Successfully updated karma reason!
February 7, 2009 12:20:33 AM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

I just sent four minidump reports all of which happened a few minutes ago, I also sent the saved game and its stats, I hope you guys can find it useful.

Reason for Karma (Optional)
Successfully updated karma reason!
September 9, 2009 8:30:23 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

what is this crap?

 

'Entrenchment has detected files from a previous beta installation.  Please uninstall Sins and Entrenchment via Impulse and reinstall both.'

 

i am not reinstalling this crap for the 4th time to get rid of this error.

Reason for Karma (Optional)
Successfully updated karma reason!
September 9, 2009 10:59:49 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

You have to manually delete the install folder after an uninstall if this happens. Sorry, but there's no way to fix it other than another re-install into a completely clean folder path.

Reason for Karma (Optional)
Successfully updated karma reason!
November 23, 2009 7:28:27 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

Oops

Reason for Karma (Optional)
Successfully updated karma reason!
Stardock Forums v1.0.0.0    #108436  walnut3   Server Load Time: 00:00:00.0000969   Page Render Time: