Can this software adjust current partitions?

[Pawkeshup]

OK, let me fully explain here first:

I have a PS2 that can no longer update FFXI due to a space constraint perceived by the software. The HDD reads that it has 24 GB left, but the program is stating that it cannot download the 1 GB file, that there is no room.

So, I'm thinking that the partition the game has created is too small, and that the game cannot write outside of it. Square-Enix is refusing to fix the issue, so I have to do it myself.

I saw that this software can create and modify new partitions, but is it possible for it to increase current partitions too?

[dlanor]

OK, let me fully explain here first:

I have a PS2 that can no longer update FFXI due to a space constraint perceived by the software. The HDD reads that it has 24 GB left, but the program is stating that it cannot download the 1 GB file, that there is no room.

So, I'm thinking that the partition the game has created is too small, and that the game cannot write outside of it. Square-Enix is refusing to fix the issue, so I have to do it myself.

I saw that this software can create and modify new partitions, but is it possible for it to increase current partitions too?

The uLE HddManager does have an 'Expand' command which allows expansion of a user partition in increments of 128 MB.

That command is mainly implemented for 'User' type partitions, recognized by the '+' prefix to each partition name.

'Expand' is not intended for 'System' type partitions recognized by the "__" prefix, and is often blocked also for 'Application' type partitions, including all those used by CodeBreaker and games installed for HDL.

But some of the 'Application' type partitions can be expanded, just like the 'User' type.

I don't have PS2 FF11, so I am unable to test this myself, but if you see the 'Expand' command in 'active' color in the popup menu opened by using R1 button when that partition is selected in the uLE HddManager, then you should be able to make that partition grow, without losing existing contents. But even though all content remains, the game code may possibly get confused by an unexpected partition size. I really don't know whether the game will accept such new partition size or not.

If you try this, be aware that the command can take a few minutes to complete, and if you interrupt this work by impatiently resetting the console, that can corrupt your HDD content.

Procedure steps:

01: Launch uLE
02: Open FileBrowser to pseudo device "MISC/"
03: Start "MISC/HddManager"
04: Wait for partition scan to complete
05: Select the partition of FF11
06: Press R1 to open the command popup menu
07: If 'Expand' command in popup menu is greyed out you must give up, so press 'Triangle' and go to step 12
08: Select enabled 'Expand' command and activate it (opens expansion popup)
09: Press Dpad_Right button once for each 128MB block you wish to add
10: Press the 'action' button (either 'O' or 'X' depending on uLE config) to start expansion
11: Wait for expansion to complete (when screen garbage from expansion popup is gone)
12: Press 'Triangle' button to exit from HddManager to uLE's main menu
13: After changing partitions in HddManager, always restart uLE (to reload device drivers).

Note that I do not even know if this can be done or not (if 'Expand' is blocked), and I also do not know if it will help even if it is done properly. If the FF11 code testing free size simply ignores the extra size added, then this addition obviously will not help.

But if the FF11 code just checks for the largest free block in the whole partition, then the method can help, provided the block you add is large enough for the update you wanted.

Even so, this problem is likely to come back for future updates, as it is due to mismanagement of the partition. Apparently game updates require completely non-fragmented storage, while the other file handling in that partition is done without proper consideration for how it fragments the free space, and without any method for cleanup.

That is why Square-Enix only suggest that each user with this problem should make a clean install of the game, as that is the only way to get it back to a state where all free space in the FF11 partition is non-fragmented.

If you are to use several different add-ons for the game, then it is probably best to install them all in direct sequence after a clean install, so that no fragmentation of the free space can hinder efficient usage of the partition space.

Best regards: dlanor

[Pawkeshup]

Well that.. that's a damned specific answer, thank you very much!

I was mainly looking into it as a workable solution to at least get the system back on its feet. The system no longer reads CDs, and the initial install disk is, sadly, a blue-backed CD. I actually got it to read the utility disk by flipping it upside down (something that, to this day, baffles me as to WHY it works. Either it's a gap-related issue or a rotational issue, but either way... leaves me scratching my head). However, it seems to still struggle to get going, and considering that an install will take much more reading time than loading the utilities, I'm concerned at how successful a reinstall will actually be.

I will definitely make the effort, even if it's not a guarantee. It's a desperate last attempt, as I've looked for another PS2 SCH 5001 model, and there's none to be had locally.

I'll be sure to post whether or not it's successful. Given SE's spaghetti coding, I'm not going to place a bet on success OR failure.

Thank you again for the reply!

[dlsmd]

OK, let me fully explain here first:

I have a PS2 that can no longer update FFXI due to a space constraint perceived by the software. The HDD reads that it has 24 GB left, but the program is stating that it cannot download the 1 GB file, that there is no room.

So, I'm thinking that the partition the game has created is too small, and that the game cannot write outside of it. Square-Enix is refusing to fix the issue, so I have to do it myself.

I saw that this software can create and modify new partitions, but is it possible for it to increase current partitions too?

The uLE HddManager does have an 'Expand' command which allows expansion of a user partition in increments of 128 MB.

That command is mainly implemented for 'User' type partitions, recognized by the '+' prefix to each partition name.

'Expand' is not intended for 'System' type partitions recognized by the "__" prefix, and is often blocked also for 'Application' type partitions, including all those used by CodeBreaker and games installed for HDL.

But some of the 'Application' type partitions can be expanded, just like the 'User' type.

I don't have PS2 FF11, so I am unable to test this myself, but if you see the 'Expand' command in 'active' color in the popup menu opened by using R1 button when that partition is selected in the uLE HddManager, then you should be able to make that partition grow, without losing existing contents. But even though all content remains, the game code may possibly get confused by an unexpected partition size. I really don't know whether the game will accept such new partition size or not.

If you try this, be aware that the command can take a few minutes to complete, and if you interrupt this work by impatiently resetting the console, that can corrupt your HDD content.

Procedure steps:

01: Launch uLE
02: Open FileBrowser to pseudo device "MISC/"
03: Start "MISC/HddManager"
04: Wait for partition scan to complete
05: Select the partition of FF11
06: Press R1 to open the command popup menu
07: If 'Expand' command in popup menu is greyed out you must give up, so press 'Triangle' and go to step 12
08: Select enabled 'Expand' command and activate it (opens expansion popup)
09: Press Dpad_Right button once for each 128MB block you wish to add
10: Press the 'action' button (either 'O' or 'X' depending on uLE config) to start expansion
11: Wait for expansion to complete (when screen garbage from expansion popup is gone)
12: Press 'Triangle' button to exit from HddManager to uLE's main menu
13: After changing partitions in HddManager, always restart uLE (to reload device drivers).

Note that I do not even know if this can be done or not (if 'Expand' is blocked), and I also do not know if it will help even if it is done properly. If the FF11 code testing free size simply ignores the extra size added, then this addition obviously will not help.

But if the FF11 code just checks for the largest free block in the whole partition, then the method can help, provided the block you add is large enough for the update you wanted.

Even so, this problem is likely to come back for future updates, as it is due to mismanagement of the partition. Apparently game updates require completely non-fragmented storage, while the other file handling in that partition is done without proper consideration for how it fragments the free space, and without any method for cleanup.

That is why Square-Enix only suggest that each user with this problem should make a clean install of the game, as that is the only way to get it back to a state where all free space in the FF11 partition is non-fragmented.

If you are to use several different add-ons for the game, then it is probably best to install them all in direct sequence after a clean install, so that no fragmentation of the free space can hinder efficient usage of the partition space.

Best regards: dlanor

if you have any hdl/opl partitions on your hdd (games and the like) thare is no way to install more stuff from ffxi because ffxi thinks that your at he end of the drive because the partition for ffxi is dynamic(in other words when you install ffxi it creates a partition but if it needs more space it just allocates more space as needed) which is the same for all things that install to the hdd

[dlanor]

if you have any hdl/opl partitions on your hdd (games and the like) thare is no way to install more stuff from ffxi because ffxi thinks that your at he end of the drive because the partition for ffxi is dynamic(in other words when you install ffxi it creates a partition but if it needs more space it just allocates more space as needed) which is the same for all things that install to the hdd

Interesting! I did not know that FF11 used a dynamic allocation method to extend its partition.

However, that makes it all the more odd that this problem is so widespread (as googled), if all it would take to fix it is to ensure that some free space remains on the HDD, and it also does not match the fact that Pawkeshup clearly stated having 24 GB free on his HDD. Properly working dynamic allocation should be able to use that space, regardless of whether or not there also are some other partitions (HDL etc) on the drive.

Somehow this doesn't quite add up...

Best regards: dlanor

[Pawkeshup]

I'm afraid DLSMD is mistaken, it does not dynamically allocate space. When Treasures of Aht Urghan was released, there was at least one update done to expand the partition space for the game data.

And if there's any question as to whether or not it can allocate data, this video pretty much puts it to rest:

[ame=http://www.youtube.com/watch?v=OPS-7c7f04Y]YouTube - Square-Enix, Fix your damn game! [FFXI PS2 update issue][/ame]

[dlsmd]

Interesting! I did not know that FF11 used a dynamic allocation method to extend its partition.

However, that makes it all the more odd that this problem is so widespread (as googled), if all it would take to fix it is to ensure that some free space remains on the HDD, and it also does not match the fact that Pawkeshup clearly stated having 24 GB free on his HDD. Properly working dynamic allocation should be able to use that space, regardless of whether or not there also are some other partitions (HDL etc) on the drive.

Somehow this doesn't quite add up...

Best regards: dlanor

actually its all software that runs from the hdd

all of the _ partitions are dynamic (or rather continuous on the drive, dynamic is just the easiest way to explain it, but thay need to be contiguous)

so if you try to install past the barrier of a + partition it will fail i know this to be a fact i have tried to use my ffxi hdd after installing

if you look at it through winhiip in the utilites/scan-repair it keeps adding new pp partitions but thay are contiguous even when adding expansions

in the image below you will see the hdloader settings that was added after the ffxi install, the empty space is ware ffxi install removed some files

tetra master is located just above hdloader settings if i were to try and update it it would fail because it would have no ware to expand to

@Pawkeshup
did you create that vid??
if so did you have any hdl games installed??
if so that would be your problem

@opl devs
this is another reason i would like it to be able to use the toxic os partition
because i know thare is a way to spoof the ps2 hdd info to another drive(im trying to remember ware i saw it on this site)to ware you can use the drive without a mod chip that has auto ata patching
so the ps2 can use the first 123gb for things like ffxi and others

[Pawkeshup]

actually its all software that runs from the hdd

all of the _ partitions are dynamic (or rather continuous on the drive, dynamic is just the easiest way to explain it, but thay need to be contiguous)

so if you try to install past the barrier of a + partition it will fail i know this to be a fact i have tried to use my ffxi hdd after installing

if you look at it through winhiip in the utilites/scan-repair it keeps adding new pp partitions but thay are contiguous even when adding expansions

in the image below you will see the hdloader settings that was added after the ffxi install, the empty space is ware ffxi install removed some files

tetra master is located just above hdloader settings if i were to try and update it it would fail because it would have no ware to expand to

@Pawkeshup
did you create that vid??
if so did you have any hdl games installed??
if so that would be your problem

@opl devs
this is another reason i would like it to be able to use the toxic os partition
because i know thare is a way to spoof the ps2 hdd info to another drive(im trying to remember ware i saw it on this site)to ware you can use the drive without a mod chip that has auto ata patching
so the ps2 can use the first 123gb for things like ffxi and others

First, FFXI itself does not create a dynamic partition. It can't, otherwise it would be able to update. If you watched the video (which is mine), you can clearly see it is not seeing any of the free space. And, while I cannot locate it at the moment, there was an update done around the time Aht Urgah released that increased the partition size.

I have never used this software, nor attempted to access the PS2's HDD before. My questions here are a last attempt I am trying in order to correct the issue SE have not.

There is nothing else on the HDD. It's been defragmented, so the drive is 100% contiguous as far as I am aware, and as far as the utilities I have state.

In fact, before this thread, I didn't even have HDA, which should be shipping to me shortly.

If you want to attempt to expand the FFXI partition to verify if this software can adjust it, then by all means... Otherwise, I'm continuing on with my plan to attempt it the moment those disks are in my hands.

[dlanor]

actually its all software that runs from the hdd

all of the _ partitions are dynamic (or rather continuous on the drive, dynamic is just the easiest way to explain it, but thay need to be contiguous)

That must be hard to test properly, as normally allocated 'system' partitions ("__" prefix) would only leave contiguous free space after the last of them. So this kind of dynamical partition growth (not allocation) would only be possible for a single partition on the HDD.

so if you try to install past the barrier of a + partition it will fail

I fail to see the logic in this. Why would only 'user' partitions ('+' prefix) have this effect ? I think it must be exactly the same for any type of partition, whether it is 'user', 'system', or 'application' (such as "PP." and others without specific prefix). Anything other than a free sector block would have the same effect of putting a stop to the kind of linear growth you describe. And this means that in a sensible multi-partition HDD implementation such a linear growth ability is useless.

i know this to be a fact i have tried to use my ffxi hdd after installing

I agree on that part, for two alternate reasons.
1: I still have not seen or heard of any practical example showing FF11 partition growth.
2: As stated above, such linear growth would be stopped by ANY sector allocation made to ANY partition other than the FF11 partition.

As yet I can't say which of those two reasons is the dominant one, causing the symptoms seen by you guys, and I can't test it myself as FF11 is not available here.

if you look at it through winhiip in the utilites/scan-repair it keeps adding new pp partitions but thay are contiguous even when adding expansions

That proves nothing about the supposed ability of FF11 to make the partition grow at will, given contiguous free space. That is an entirely separate issue. Proof of that would require captured state info taken before such growth and then again after it, to allow proper comparison.

in the image below you will see the hdloader settings that was added after the ffxi install, the empty space is ware ffxi install removed some files

tetra master is located just above hdloader settings

In fact I can not see all the details you mentioned here, but I'll take your word for the storage order etc. I still don't see how any of that can help though.

if i were to try and update it it would fail because it would have no ware to expand to

That may well be, but only because of an idiotic method where linear growth is required instead of random-addressable allocation. This is particularly stupid since the underlying HDD drivers are capable of proper random-addressable allocation. The only limitation of it is that each allocated block must consist of contiguous sectors, but there is NO requirement that such blocks making up a logical partition must be contiguous with each other.

Or is there ?
Come to think of it, most of my experience is with homebrew replacement device drivers, and they do NOT have such a requirement. But I can't really be sure of how it works with original Sony drivers, as I never use those.

@Pawkeshup
did you create that vid??
if so did you have any hdl games installed??
if so that would be your problem

That may well be involved in his problem, but I think you dismiss the possibility of fragmentation problems inside the FF11 partition too easily.

Even so, trying to take both those theories into account, it may be possible to think up a method that eliminates both problems, though that may require a reinstall of the game and reformatting of the drive, so as to start with a 'clean slate'.

What if you were to reformat the HDD and then reinstall the usual stuff up to and including FF11. At this point you then proceed to install all the FF11 game extensions and add-ons that you already have, which should work without problems as nothing else can block linear growth. And if a space error occurs during this work (indicating fragmentation problem inside the partition or a growth problem), then you simply take a pause in this work and attempt to use uLE's HddManager (or other HDD utility) to expand the FF11 partition by the size needed. And when all available extras for FF11 have been installed, the same tool is used for a final expansion of that partition, this time by several GiB, so as to cope with future add-ons.

If this is done right you should then be able to also install other unrelated stuff on the HDD, while still retaining the space pre-allocated in the final step above for future use by FF11.

The only big question-mark here, for me anyway, is whether or not FF11 will use already allocated space at all for future add-on installs. If it really demands linear partition growth for all new stuff to be added, then there is no solution for this problem, as it would then regard the end of the free block already allocated as the starting point of new growth...

But that is something we should not just assume, but need to test.
And unfortunately that is something I can not participate in...

Best regards: dlanor

[dlsmd]

i will do this tommarrow as it is new years eve i will
1. format my hdd with the hdd disk then capture with winhiip
2. install fxii then capture with winhiip
3. defrag hdd then capture with winhiip
4. install game for opl then capture with winhiip
5. try to install my ffxi 2008 vana'diel collection then capture with winhiip

then i will do another test and skip step 4