Hangs when importing Mame set

If you encounter bugs, errors or crashes, please report them in this section so we can try to fix it!
retroboyz
Posts: 45
Joined: 16 Sep 2012, 21:25

Hangs when importing Mame set

Unread post by retroboyz » 12 Nov 2012, 22:59

I'm trying to import a full Mame set, and it hangs after a while. I've left it on overnight and nothing happened.
When I restart ECC, no Mame roms have been imported.

User avatar
Phoenix
ECC Developer 2006-2016
Posts: 9058
Joined: 27 Aug 2006, 01:17
Location: Deventer, The Netherlands
Contact:

Re: Hangs when importing Mame set

Unread post by Phoenix » 12 Nov 2012, 23:38

Hi retroboyz,

What is the filestructure?, and are the ROMS zipped? (NOT RAR, 7Z, OR extracted into seperate folders!)

Could you do a 'dir /s > mydir.txt' command in the '[userfolder]\mame' folder?
Sebastiaan Ebeltjes | ECC Developer 2006-2016 | ECC Forum Admin | Phoenix Interactive WebMaster
[- ECC programs -]
eccUpdate, eccScriptSystem, GtkThemeSelect, DatFileUpdater (DFU), ImagePackCenter (IPC), eccDiagnostics, 3dGallery, iccImageInject
eccKameleonCode, eccCreateStartmenuShotcut, eccThirdPartyConfig (TPC), EmuMoviesDownloader (EMD), eccVideoPlayer
MobyGamesImporter (MGI), ECC Amiga GetGemusConfig.

retroboyz
Posts: 45
Joined: 16 Sep 2012, 21:25

Re: Hangs when importing Mame set

Unread post by retroboyz » 13 Nov 2012, 08:30

Roms are zipped. Normal merged set in the mame/roms/ folder. There are subfolders for the CHDs.
Can do a dir tonight :) i suppose you want a list of the roms, or what would you need?

User avatar
Phoenix
ECC Developer 2006-2016
Posts: 9058
Joined: 27 Aug 2006, 01:17
Location: Deventer, The Netherlands
Contact:

Re: Hangs when importing Mame set

Unread post by Phoenix » 13 Nov 2012, 10:21

Actually this should work though...well i wanted to look how the file & folder structure on you side looks like, if ECC can find the roms etc...

1) do you see a parsing counter in ECC that's shows the processing of parsing?

I'll try something out this week and see if it works on my side properly...or if i could find the thing that's causing no import...
Sebastiaan Ebeltjes | ECC Developer 2006-2016 | ECC Forum Admin | Phoenix Interactive WebMaster
[- ECC programs -]
eccUpdate, eccScriptSystem, GtkThemeSelect, DatFileUpdater (DFU), ImagePackCenter (IPC), eccDiagnostics, 3dGallery, iccImageInject
eccKameleonCode, eccCreateStartmenuShotcut, eccThirdPartyConfig (TPC), EmuMoviesDownloader (EMD), eccVideoPlayer
MobyGamesImporter (MGI), ECC Amiga GetGemusConfig.

retroboyz
Posts: 45
Joined: 16 Sep 2012, 21:25

Re: Hangs when importing Mame set

Unread post by retroboyz » 14 Nov 2012, 05:04

I see it for a while. It sees the correct number to import too. But after a while, it just hangs and gives a white screen. I think it's because it's parsing the big roms and looking inside them.

User avatar
Jarlaxe
ECC Support
Posts: 96
Joined: 29 Aug 2008, 19:12
Location: Barcelona, Spain

Re: Hangs when importing Mame set

Unread post by Jarlaxe » 15 Nov 2012, 11:34

Also happens to me. I have the same problem.

When ECC try to patch big roms, the program don't respond :cry:

retroboyz
Posts: 45
Joined: 16 Sep 2012, 21:25

Re: Hangs when importing Mame set

Unread post by retroboyz » 15 Nov 2012, 20:39

I think the import happens, but when too many "big rom" imports happen, it hangs. Could be a memory leak?

User avatar
Phoenix
ECC Developer 2006-2016
Posts: 9058
Joined: 27 Aug 2006, 01:17
Location: Deventer, The Netherlands
Contact:

Re: Hangs when importing Mame set

Unread post by Phoenix » 15 Nov 2012, 22:01

Well i really don't know, it could be, i haven't tried it yet...

So it's parses some big files?...but not too much?
Sebastiaan Ebeltjes | ECC Developer 2006-2016 | ECC Forum Admin | Phoenix Interactive WebMaster
[- ECC programs -]
eccUpdate, eccScriptSystem, GtkThemeSelect, DatFileUpdater (DFU), ImagePackCenter (IPC), eccDiagnostics, 3dGallery, iccImageInject
eccKameleonCode, eccCreateStartmenuShotcut, eccThirdPartyConfig (TPC), EmuMoviesDownloader (EMD), eccVideoPlayer
MobyGamesImporter (MGI), ECC Amiga GetGemusConfig.

retroboyz
Posts: 45
Joined: 16 Sep 2012, 21:25

Re: Hangs when importing Mame set

Unread post by retroboyz » 16 Nov 2012, 18:31

You know when you parse a big rom and it gives you a warning about how it's going to scan a big rom? :) there are many of them in a row. When you scan several of them, this happens.

retroboyz
Posts: 45
Joined: 16 Sep 2012, 21:25

Re: Hangs when importing Mame set

Unread post by retroboyz » 24 Nov 2012, 18:12

Any news on this one?

User avatar
Phoenix
ECC Developer 2006-2016
Posts: 9058
Joined: 27 Aug 2006, 01:17
Location: Deventer, The Netherlands
Contact:

Re: Hangs when importing Mame set

Unread post by Phoenix » 24 Nov 2012, 18:30

I will parse a MAME set this evening, i'll see if it makes ECC hang...
Sebastiaan Ebeltjes | ECC Developer 2006-2016 | ECC Forum Admin | Phoenix Interactive WebMaster
[- ECC programs -]
eccUpdate, eccScriptSystem, GtkThemeSelect, DatFileUpdater (DFU), ImagePackCenter (IPC), eccDiagnostics, 3dGallery, iccImageInject
eccKameleonCode, eccCreateStartmenuShotcut, eccThirdPartyConfig (TPC), EmuMoviesDownloader (EMD), eccVideoPlayer
MobyGamesImporter (MGI), ECC Amiga GetGemusConfig.

User avatar
Phoenix
ECC Developer 2006-2016
Posts: 9058
Joined: 27 Aug 2006, 01:17
Location: Deventer, The Netherlands
Contact:

Re: Hangs when importing Mame set

Unread post by Phoenix » 24 Nov 2012, 19:11

Well, i've imported a whole MAME set v0.146 8160 ROMS, no problems at all :-k , maybe you guys have a invalid zip file wich makes the parser crash?
please enable 'write log file' in the ECC config and restart ECC, repars the MAME set again, if it's good it will write a file called 'ecc-user-logs\rom_parsing.txt', maybe in here we can see what's going wrong on your side?!

Also ECC doesn't leak memory when parsing...so that's good :-"

Start parsing:
ecc_mame_parsing.png
ecc_mame_parsing.png (12.75 KiB) Viewed 2135 times
Some 'Big file' warning:
ecc_mame_parsing_02.png
Memory check...all ok:
ecc_mame_parsing_03.jpg
ecc_mame_parsing_04.jpg
ecc_mame_parsing_05.jpg
Done parsing a full MAME 0.146 set:
ecc_mame_parsing_06.jpg
LOG results:
Attachments
rom_parsing.zip
(79.02 KiB) Downloaded 39 times
Sebastiaan Ebeltjes | ECC Developer 2006-2016 | ECC Forum Admin | Phoenix Interactive WebMaster
[- ECC programs -]
eccUpdate, eccScriptSystem, GtkThemeSelect, DatFileUpdater (DFU), ImagePackCenter (IPC), eccDiagnostics, 3dGallery, iccImageInject
eccKameleonCode, eccCreateStartmenuShotcut, eccThirdPartyConfig (TPC), EmuMoviesDownloader (EMD), eccVideoPlayer
MobyGamesImporter (MGI), ECC Amiga GetGemusConfig.

retroboyz
Posts: 45
Joined: 16 Sep 2012, 21:25

Re: Hangs when importing Mame set

Unread post by retroboyz » 27 Nov 2012, 22:53

It hanged again. Here's the Windows error.

Description:
A problem caused this program to stop interacting with Windows.

Problem signature:
Problem Event Name: AppHangB1
Application Name: php.exe
Application Version: 5.2.5.5
Application Timestamp: 4733e2f0
Hang Signature: b27d
Hang Type: 0
OS Version: 6.1.7601.2.1.0.768.3
Locale ID: 1033
Additional Hang Signature 1: b27de6d81053bf80689f0d6e44231a61
Additional Hang Signature 2: 8c82
Additional Hang Signature 3: 8c82f45e84b3641b2018ce596715c718
Additional Hang Signature 4: b27d
Additional Hang Signature 5: b27de6d81053bf80689f0d6e44231a61
Additional Hang Signature 6: 8c82
Additional Hang Signature 7: 8c82f45e84b3641b2018ce596715c718

Read our privacy statement online:
http://go.microsoft.com/fwlink/?linkid= ... cid=0x0409

If the online privacy statement is not available, please read our privacy statement offline:
C:\Windows\system32\en-US\erofflps.txt



Also, the log: http://pastebin.com/TcBKUwSy
Next rom would have been j6impactb.zip 88kp

User avatar
Phoenix
ECC Developer 2006-2016
Posts: 9058
Joined: 27 Aug 2006, 01:17
Location: Deventer, The Netherlands
Contact:

Re: Hangs when importing Mame set

Unread post by Phoenix » 28 Nov 2012, 01:37

Hi retroboyz,

I may have found the problem... :detective: , it's the same issue as the video player that would not start (wich is fixed now)....

There is still an old 'start /B' found in 'ecc-system\cOs.php', i tried to replace it with a com object but 'fopen' and 'fclose' won't work then...so i have to experiment with this...

cOs.php: (original code)

Code: Select all

	public function executeCommand($command, $cwdPath = false, $returnCwdPath = false, $useExec = false){
		
		# windows start tool
		$commandWinStart  = 'start /B';
		$commandWinStart .= ($this->os_env['OS'] == 'WINNT') ? ' "player"' : ''; # win98 needs "player". Otherwise, the file isn't started
		$executeCommand = $commandWinStart.' '.$command; # Compile start command
		$cwdBackup = getcwd(); # create an backup of the current cwd	
		if($cwdPath) chdir($cwdPath); # change dir to the programs directory

		if($useExec) exec($executeCommand); # execute this command
		else pclose(popen($executeCommand, "r")); # execute command
cOs.php: (FIX attempt)

Code: Select all

	public function executeCommand($command, $cwdPath = false, $returnCwdPath = false, $useExec = false){
	
		$cwdBackup = getcwd(); # create an backup of the current cwd	
		if($cwdPath) chdir($cwdPath); # change dir to the programs directory
		
		if($useExec) {
			$shell = new COM("WScript.Shell"); // Using COM object to disable waiting for the script to finish! (start /b doens't work for all computers and OS'es)
			$shell->run($command, 0, false);
		}
		else	{
			$shell = new COM("WScript.Shell"); // Using COM object to disable waiting for the script to finish! (start /b doens't work for all computers and OS'es)
			pclose(popen($shell->run($command, 0, false), "r")); # execute command
		}
Sebastiaan Ebeltjes | ECC Developer 2006-2016 | ECC Forum Admin | Phoenix Interactive WebMaster
[- ECC programs -]
eccUpdate, eccScriptSystem, GtkThemeSelect, DatFileUpdater (DFU), ImagePackCenter (IPC), eccDiagnostics, 3dGallery, iccImageInject
eccKameleonCode, eccCreateStartmenuShotcut, eccThirdPartyConfig (TPC), EmuMoviesDownloader (EMD), eccVideoPlayer
MobyGamesImporter (MGI), ECC Amiga GetGemusConfig.

retroboyz
Posts: 45
Joined: 16 Sep 2012, 21:25

Re: Hangs when importing Mame set

Unread post by retroboyz » 28 Nov 2012, 23:58

Changed the php. Now it's been parsing the same file for an hour:

Parsing (fsum) arcanaheart.u1 (1056Mb) Pass 133151333...

It's running lots of passes on this and not moving to the next file.

User avatar
Phoenix
ECC Developer 2006-2016
Posts: 9058
Joined: 27 Aug 2006, 01:17
Location: Deventer, The Netherlands
Contact:

Re: Hangs when importing Mame set

Unread post by Phoenix » 29 Nov 2012, 16:23

yes as it is said in the post above it was an attempt...;-)
Sebastiaan Ebeltjes | ECC Developer 2006-2016 | ECC Forum Admin | Phoenix Interactive WebMaster
[- ECC programs -]
eccUpdate, eccScriptSystem, GtkThemeSelect, DatFileUpdater (DFU), ImagePackCenter (IPC), eccDiagnostics, 3dGallery, iccImageInject
eccKameleonCode, eccCreateStartmenuShotcut, eccThirdPartyConfig (TPC), EmuMoviesDownloader (EMD), eccVideoPlayer
MobyGamesImporter (MGI), ECC Amiga GetGemusConfig.

retroboyz
Posts: 45
Joined: 16 Sep 2012, 21:25

Re: Hangs when importing Mame set

Unread post by retroboyz » 29 Nov 2012, 16:37

No problem! Any way to prevent it from doing all these passes? Or do you think there is a workaround?

User avatar
Phoenix
ECC Developer 2006-2016
Posts: 9058
Joined: 27 Aug 2006, 01:17
Location: Deventer, The Netherlands
Contact:

Re: Hangs when importing Mame set

Unread post by Phoenix » 29 Nov 2012, 18:19

I believe there is a workaround, i only have to play and experiment with PHP ;-)
Sebastiaan Ebeltjes | ECC Developer 2006-2016 | ECC Forum Admin | Phoenix Interactive WebMaster
[- ECC programs -]
eccUpdate, eccScriptSystem, GtkThemeSelect, DatFileUpdater (DFU), ImagePackCenter (IPC), eccDiagnostics, 3dGallery, iccImageInject
eccKameleonCode, eccCreateStartmenuShotcut, eccThirdPartyConfig (TPC), EmuMoviesDownloader (EMD), eccVideoPlayer
MobyGamesImporter (MGI), ECC Amiga GetGemusConfig.

User avatar
Phoenix
ECC Developer 2006-2016
Posts: 9058
Joined: 27 Aug 2006, 01:17
Location: Deventer, The Netherlands
Contact:

Re: Hangs when importing Mame set

Unread post by Phoenix » 29 Nov 2012, 23:17

After 5 hours of testing and experimenting, i came to the conclusion i have to build a small AutoIt wrapper for fsum.exe, otherwise i cannot use the PHP COM object...

Also the PHP COM object doesn't support a parameter like: 'program.exe >file.txt' (only with start /b), wich fsum commandline uses to store data to a file...

i tried it with a 'windows command' wrapper -> CMD...like 'fsum.cmd file.rom'...also no luck!

Code: Select all

@ECHO OFF
fsum.exe -crc32 %1 >file.chk
pff... back to the drawing board...
Sebastiaan Ebeltjes | ECC Developer 2006-2016 | ECC Forum Admin | Phoenix Interactive WebMaster
[- ECC programs -]
eccUpdate, eccScriptSystem, GtkThemeSelect, DatFileUpdater (DFU), ImagePackCenter (IPC), eccDiagnostics, 3dGallery, iccImageInject
eccKameleonCode, eccCreateStartmenuShotcut, eccThirdPartyConfig (TPC), EmuMoviesDownloader (EMD), eccVideoPlayer
MobyGamesImporter (MGI), ECC Amiga GetGemusConfig.

User avatar
Phoenix
ECC Developer 2006-2016
Posts: 9058
Joined: 27 Aug 2006, 01:17
Location: Deventer, The Netherlands
Contact:

Re: Hangs when importing Mame set

Unread post by Phoenix » 30 Nov 2012, 01:23

Hi retroboyz,

I have finished the new PHP COM object with Autoit3 wrapper, can you test if all parsing still works good, als try to import your MAME set again!
I have removed FSUM support for now, because of the above issue (a few posts back), and implemented a AutoIt3 CRC32 wrapper wich is a bit slower, but working flawlessly!

I've tested it myself on a 500MB and 10GB file, all OK! :-"

Download:
*Edit: file removed, will be added in the next update!
(extract the contents into your ECC folder and overwrite all files if asked)

Let me know if the parsing of BIG files is working properly now! :clapshout:
Sebastiaan Ebeltjes | ECC Developer 2006-2016 | ECC Forum Admin | Phoenix Interactive WebMaster
[- ECC programs -]
eccUpdate, eccScriptSystem, GtkThemeSelect, DatFileUpdater (DFU), ImagePackCenter (IPC), eccDiagnostics, 3dGallery, iccImageInject
eccKameleonCode, eccCreateStartmenuShotcut, eccThirdPartyConfig (TPC), EmuMoviesDownloader (EMD), eccVideoPlayer
MobyGamesImporter (MGI), ECC Amiga GetGemusConfig.

Post Reply

Who is online

Users browsing this forum: No registered users and 1 guest