Sins of a Solar Empire : Real-Time Strategy. Unrivalled Scale.
© 2003-2016 Ironclad Games Corporation Vancouver, BC. All rights reserved.
© 2006-2016 Stardock Entertainment

{utility release} GUI for convertdata to automate the conversion of files in folders between BIN & TXT

harpos TXT BINner *v1.19.12* as at 15/3/2010

By on May 23, 2009 6:19:26 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

harpo99999

Join Date 02/2008
+405

I have started coding on another little program for automated conversion of files between txt & bin formats using the actual convertdata*.exe's and the correct convertdata for the files based on the pathname eg for entrenchment mods/reference files the path should contain "entrenchment" ditto for the next expansions, and for vanilla sins it SHOULD NOT contain any of the expansions names also it will work on all drives in the computer BUT does need the sins installation in the location pointed to by the registy.

it will also be able to make TXTed reference files as easily as converting an entire mod to/from bin

to make your own reference set you first COPY the program files sins folder to another location in the computer like for example 'my documents', then delete FROM THE COPY the appdata,font & sdplugins folders and the dll and exe files in the root of the copy then run the txt binner doing the entrenchment folder first then any other expansions you have and finally the vanilla sins and for each folder note which files have FAILED conversion

a more detailed overview of the program

psudo code outline

get the conversion type

get the location to convert

determine which convertdata to use based on the location (all three expansions will be supported)

scan the location to create a list of all files

for each file in the list use the convertdata to convert each file if it is NOT the type wanted, then test to see if it was converted correctly, if not list it in the failed conversion list, if it was  then list it in the success list

end psudo code outline

note additional minor feature if you have a location you want to use as a sins reference files location and want it to be accessably with a single button then create a sinsref.txt in the same folder as the txt binner.exe and have as the first line of the file as the path to your sins reference location eg 'f:\sins reference'  note the LACK of trailing backslash the program does not want it

the new versions of the mod updater and TXT BIN GUI use the correct version of the convertdata to do the actual convesion to text/bin eg updateing mods from entrenchment 1.01 to 1.03 the mod updater converts to text with convertdata_entrenchment1.01.exe and updates the entities, then converts back to bin with convertdata_entrenchment 1.03.exe.

I suggest not using the old version files the current is 1.1

the latest version is included in the utility pack that an be downloaded from my mod updater thread

 

harpo

my new txt bin converter GUI

238 Replies +2
Search this post
Subscription Options


Reason for Karma (Optional)
Successfully updated karma reason!
April 22, 2012 6:11:11 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

did you try the links in the reply above yours?, they work for me.

harpo

Reason for Karma (Optional)
Successfully updated karma reason!
April 22, 2012 6:49:17 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

posting here so I will see replies.

Reason for Karma (Optional)
Successfully updated karma reason!
May 4, 2012 6:01:53 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

just a quick note to let you all know that I am currently updating the textbig gui to work with rebellion AND trinity/sins/entrenchment/diplomacy, but the different paths are causing some issues., but at present it looks like I might be close to having a beta grade version available in the next couple of weeks (rl permitting (15 hour days with 1- 1.5 hours travel on top))

harpo

 

Reason for Karma (Optional)
Successfully updated karma reason!
May 5, 2012 4:48:39 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

With Rebellion being stand alone it is both a good, and bad thing. Obviously the good outweighs the bad, because you wont have to worry about conflicting files from trinity, or the confusion of what mod works for which version of sins. Mods made for Rebellion will be strictly for Rebellion only.

The bad of course is that rebellion uses different paths than trinity. Not really a bad thing just a minor annoyance from confusion.

Reason for Karma (Optional)
Successfully updated karma reason!
May 5, 2012 5:37:22 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

for those of us that WANT to test and help debug with the beta of my textbin gui (note it is intended as rebellion AND sins entrench/dip/trinity friendly so should work with all expansions) here is a link (http://dl.dropbox.com/u/8023186/sins%20modding%20utilities/sinstextbinner2.exe), just save it into the same folder as the rest of my utilities and as it has a different name to my sins only it will NOT overwrite the working version.

and just a reminder that my utilities look at the PATH to the file to choose the convertdata to use, eg folder name contains entrenchment, it uses the convertdata_entrenchment, folder name has diplomacy, it uses convertdata_diplomacy, folder name contains rebellion, it uses convertdata_rebellion, and if NONE of the preceding three conditions are met it then uses convertdata_originalsins.

harpo

 

Reason for Karma (Optional)
Successfully updated karma reason!
May 8, 2012 9:28:43 PM from Stardock Forums Stardock Forums

How much time does it normally take ? Because I've been stuck on your gui window for over an hour...

 

Nevermind, I created a Batch file, much simpler.

Reason for Karma (Optional)
Successfully updated karma reason!
May 9, 2012 4:56:41 AM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

the most likely reason for the gui to not respond is that you do NOT have the expansion name in the path to the files, and the conversion time for rebellion is  20-30 minutes which is also about the time it takes for the entire rebellion fileset to be copied from the program files area to another drive .

harpo

 

Reason for Karma (Optional)
Successfully updated karma reason!
July 20, 2012 6:40:31 AM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

and here is an update of the text bin gui for rebellion. the main difference is that there is a hidden option that is activated (the option is made available) in debug mode which is set by the fifth line in the targetsinsver.txt having debug as the total line.

the hidden option is called 'cook CPU' as it disables the wait till the convertdata finishes before starting the conversion of the next file(on my i7 2600k system with the option OFF it takes approx 11 minutes to convert a copy of rebellion and cpu temps get to 40 c and only two 'cores' are getting any significant work, and all files are correctly reported as to whether or not the cinversion was needed/successfull or failed, BUT with the option on the gui reports all the files failed to convert(they did convert, just not when the gui tested them), and ran in 6 minutes, BUT the cpu cores hit 50 c (the computer has water cooling AND was running in 18 c air temp and the idle temp for the cpu was 30c) and ALL eight 'cores' (hyperthreaded quad core) were at 100% use for the whole time.

harpo

 

Reason for Karma (Optional)
Successfully updated karma reason!
October 31, 2012 6:15:28 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

if you are getting an issue with the gui 'not responding' on win7 it might be that the ConvertDataRebellion.exe in the folder with the gui needs to be replaced with the one from your rebellion game folder as the apparent causes is the usual issue of the convertdata's from each patch are not compatible with a different patch of the same expansion or different expansions.

harpo

Reason for Karma (Optional)
Successfully updated karma reason!
January 15, 2013 1:15:19 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

Thanks again Harpo, but I think I'm a lost cause with the conversions of bin to txt. I've been trying again and again. And I'm pretty frustrated at not being able to do it. I went through the instructions again and, just in case it's something idiotically trivial I did, this is what I did.

I copied the SoaSE game directory to my documents (Trinity 1.37, without Rebellion). I deleted all the files except for gameinfo and the convertdata.exes. I directed your data converter v.1.3 to the folder and tried convert in place. Set it for bin to txt. I received the popup message 'conversion complete'. But when I looked all the Sins files are still in bin format. I did the same thing for the GameInfo for Entrenchment and Diplomacy, I directed the converter to the Entrenchment or Diplomacy folder and changed the version to the appropriate setting.

I've tried doing this on copies in various different locations as well as setting the output path elsewhere. I've tried running the converter as an administrator. The most joy I can get out of this is when I set the destination folder and select include subfolders and then select everything to ignore except GameInfo. The converter creates a GameInfo in the destination, thinks a little more and then displays the conversion complete. The spawned folder is however empty. I've also tried converting individual .entity files, with no success. My operating system is Windows 7 and my game version is the 1.37 Trinity download from Stardock. I'm opening the files converted-in place using Notepad++.

 

I tried placing copies of the ConvertData_exes from my install in the Converter program folder and received a 'Debug Assertion Failed!'

Program:..

File: fread.C

Line: 156

Expression: num < SIZE_MAX / elementSize)

Reason for Karma (Optional)
Successfully updated karma reason!
January 15, 2013 4:32:25 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

zanypilot, the text big gui assumes that it has the convertdata(expansion)(version).exe in the folder it is run from, OR the convertdata(expansion).exe in the folder installation that is pointed to in the drengin.net path values(thedrengin.net values seem to be only populated after RUNNING the sins expansion as does the mod-(expansion)(version) folders, regarding copying the convertdata's from the program folder into the textbin gui's folder, that IS exactly how I update the utility pack, and I then ADD the exact version number to the name of the convertdata(expansion).exe.

as far as my ref files production, Ihave a folder set on another drive for all versions of the reference files in text form, and when a new version has been installed I copy the latest files from my program files folder and paste it into my reference files folder, then run my textbin gui, then delete the executables(excluding the convertdata and needed files for the convertdata.exe's), the dll's, movies, sounds, textures, maps and utility folders eg galaxy forge,convertxsi,particle forge,  then zip the remaining files and folders and upload(sometimes I do this on a win7 64 bit system, other times it is on a xp system).

regarding the error, perhaps your convertdata was corrupted during the update as the error implies a C runtime error reading a file and the textbin gui is written in VB6.

harpo

 

Reason for Karma (Optional)
Successfully updated karma reason!
January 15, 2013 5:53:38 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

Thank you for your perseverance with helping me on this, its much appreciated.  I did some tinkering with files early on, perhaps I have mixed versions and that is why the converter cannot convert.  I'm going to do a game reinstall and try again. Thanks alot.

Reason for Karma (Optional)
Successfully updated karma reason!
January 16, 2013 12:48:36 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

Quoting ZanyPilot,
Thank you.... I'm going to do a game reinstall and try again...

I reinstalled Trinity v1.37 and tried the conversions using that installation's converdata_exes. OrignialSins converted without problems on your utility.  Entrenchment and Diplomacy would not convert and hung up the converter or on the sinsconverter.exe generated errors.

I reinstalled my disc Trinity v1.00 and utilising the convertdata_exes from that installation was able to convert data to and from txt without problem.

I think other than my nubness, that my ConvertData_Entrenchment.exe and ConvertData_Diplomacy.exe for the Trinity v1.37 from the Stardock download might be the problem.  I'm going to try re-downloading and re-installing, but not immediately as we have some games scheduled.

Thanks a lot for your help, sorry I'm so lame at this.

Edit: Everything is fine, all the ConvertData_exes files are good, no idea how I messed it up.  Finaly suceeded with MyFist0's batch method (I could not get individual files to convert, but the batch conversions were all good) Thanks again.  Good community.

Reason for Karma (Optional)
Successfully updated karma reason!
August 4, 2015 12:28:59 AM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

I am trying to modify a single file from ZombiesRus5's Sins of the fallen mod, and I am unable to do so with the converter. It works fine but when I hit Convert now, I get a 'not responding' message. My paths for Sins doesnt conform to the instructions (I have steam and get sins through that) so that might be the problem, or my computer might just not be strong enough? 

Please help, I really like this mod and I would like to play it at it's (to me) fullest. I'd be grateful for any help.

Reason for Karma (Optional)
Successfully updated karma reason!
August 4, 2015 4:03:35 AM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

my textbingui converts  entire mods and entire mods(entire collections of mods) folders between text & bin modes  BUT does NOT do single files and does look at the folder names to the files to determine which of the convertdata's to use, and you might want to alter the 'debug' lines in the targetsinsver.txt and sinsref.txt to NOT read 'debug'.

harpo, the ghost NON-subscriber

Reason for Karma (Optional)
Successfully updated karma reason!
August 4, 2015 9:55:17 AM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

So I just delete the lines that just say 'Debug' and 'damndebug' from those two and it should work? Also, due to some weird steam thing (I think) all the mods are kept in 'my documents' separate from Windows 7 (C:). Would i just copy the mods, alter the copies, then replace the originals with the copies?

Reason for Karma (Optional)
Successfully updated karma reason!
August 4, 2015 7:13:06 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

just CHANGE the lines so that they do NOT read 'debug', e.g. add a space in the line, delete a single letter, replace the entire word with different word,

the 'danmdebug' will be fine, the my documents are the rebellion mods only, original sins/entrenchment/diplomacy/trinity all use the user name/local path to the mods

the textbingui does INPLACE conversion of the files between modes, so there is no need to convert in another location then copy into the working mods folder to test

harpo, the ghost NON-subscriber

Reason for Karma (Optional)
Successfully updated karma reason!
August 4, 2015 8:01:29 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

It's a rebellion mod that I'm trying to change, an it has the path desktop/documents/my documents/my games/Ironclad Games/Sins of a Solar Empire Rebellion/Mods-Rebellion v1.82

It's not my own mod and There is no path to original mods because I have none.

I changed the 'debug' and left the 'damndebug' alone, but it said there was no conversion file 'ConvertData?OriginalSins.exe and closed the program. Should I be using your original one or a newer one application?

I'm sorry to be a bother and I really appreciate the help.

Reason for Karma (Optional)
Successfully updated karma reason!
August 5, 2015 7:17:25 AM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

the original I refer ti is the 'ORIGINAL' sins of a solar empire game from before the entrenchment/diplomacy/trinity expansions that then had the steam based rebellion expansion happen that also moved the saves,maps & mods into the mydocuments/my games area.

the textbingui has a couple of differnt versions (the one in the OP that is for the PRE-rebellion sins)

,and the rebellion compatible version in post 208 above.

the textbingui first checks the path(by checking the folder names) to the folder(s) to convert for the expansion name AND the version number(the reason for these checks is that the BIN code for the files differs between expansions end even versions within each expansion) first for 'entrenchment' then 'diplomacy' then 'rebellion'(in ANY mix of case) and if it does NOT find any of the expansion names it then ASSUMES the folder to be ORIGINAL sins of a solar empire, then it checks the folder names forr the VERSION number of the game, then after getting the expansion and version number it then LOOKS for the convertdata?EXPANSIONversion.exe in it's current folder, if it does NOT find the convertdata it then LOOKS for the default install location of the game(from registry keys so can be ANYWHERE in the computer)ConvertData?EXPANSION.exe (btw the reason for the '?" in the filename is there were a couple of different symbols used by ironclad/stardock in the convertdata names and I wanted to simplify the program as far as possible so used a single character wildcard in the filename search.

sorry about the wall of text, but I thought it might help to explain the workings of the program

Harpo, the ghost NON_subscriber

Reason for Karma (Optional)
Successfully updated karma reason!
August 5, 2015 9:38:28 AM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

Nah, its fine. I do actually understand it better.

I tried the one from post 208, but when I open it  it says 'registry error, unable to access the registry' do i need to put the 'ConvertData_Rebellion.exe' in the mods im changing?

Thanks again

Reason for Karma (Optional)
Successfully updated karma reason!
August 5, 2015 6:19:48 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

the convertdata's only need to be in the same folder as the textbingui OR in the game install location, but the registry error suggests that your antivirus or other defences are blocking access to the registry to prevent malware/virii from infecting thee computer, BUT to the best of my knowledge my utilities ARE virus/malware FREE and do not need to install.

you could try running as adminisitrator and see if you do not get the error.

if you are still getting the registry error, could you please let meknow which windows & antivirus/antmalware programs you are using

harpo, the ghost NON-subscriber

 

Reason for Karma (Optional)
Successfully updated karma reason!
August 5, 2015 9:44:27 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

I tried running as administrator, still happened. I have Windows 7 with VIPRE. Vipre is touchy, so it's probably whats stopping it.

Reason for Karma (Optional)
Successfully updated karma reason!
August 6, 2015 6:16:43 AM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

as I have been developing the utilities (initially with xp but now on w7 ultimate (and have been using avast free set to maximum sensitivity settings) and had no problems, but the name of your antivirus suggests it it is a bit bite first then see if it survives, then bite again and repeat.

would it be possible to disable the vipre while you  use the utility?

harpo, the ghost NON-subscriber

Reason for Karma (Optional)
Successfully updated karma reason!
August 6, 2015 12:09:04 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

I tried it just now, got the same problem.

I do have an idea, though.

Sins of a galactic empire has the exact feature im looking for, so maybe if a take the file out of there and put it in place of the RESEARCHSUBJECT_MAXCAPITALSHIPS0, change the name so as to not interfere with the path, and delete the original, would that work???

Reason for Karma (Optional)
Successfully updated karma reason!
August 6, 2015 7:37:16 PM from Sins of a Solar Empire Forums Sins of a Solar Empire Forums

if you change the name of the file from RESEARCHSUBJECT_MAXCAPITALSHIPS0 then the game will not find the file and then use the one from the base game, (if you do change the name you will also have to alter the entity.manifest AND the player files so a  lot more work)

harpo, the ghost NON-subscriber

Reason for Karma (Optional)
Successfully updated karma reason!
Stardock Forums v1.0.0.0    #108432  walnut2   Server Load Time: 00:00:00.0001984   Page Render Time: