Database Search

match allmatch any Look in all areasLook in current areas Check all datesPrevious dayPrevious 3 daysPrevious weekPrevious fortnightPrevious monthPrevious 2 monthsPrevious 3 monthsPrevious half-yearPrevious year

TechHome

	Samples from Users
	Sort

• 3-Dimensional Array
• Accessing Multidimensional Arrays
• Add a Row to a Two Dimensional Array
• Array and Lists - Split and Join
• Array copy problem
• Array Size and Making a Binary Copy
• ArrayFileGet VMalloc Error
• ArrayFileGetCsv - How to detect invalid CSV line
• ArrayInsert Examples
• Arrayize and Dimensioned Arrays
• ArrayRedim Issue
• Arrays for the Layman
• Arrays vs Item Lists Speed
• ArraySearch Duplicate Values
• ArrInitialize NULL Fails
• Convert an Array to a Delimited List
• Convert SafeArray into a WIL Array
• Convert String to an Array
• Delete a Member of an Array
• DirInfotoArray Sort
• File Names in the Shell Like Sort Order
• Filling an Array from a column in a DB
• ForEach in Array Trick
• Is it an Array
• Is there an AskArrayList
• ObjectType Error 1690 Ole Unable to Perform Enumeration of the Specified Object
• PtrPersistent and ArrInitialize Issue
• Remove a Line from a File Using Arrays
• Resize an Array
• Reverse Array
• Searching an array for data
• Secondary Sort on Columns
• Sort Files by Modified Date
• Transpose Array
• Variable Table to Array
• VMalloc Error - VirtualAlloc Failed 487
• Why use arrays

Can't find the information you are looking for here? Then leave a message over on our WinBatch Tech Support Forum.

ArrayFileGet VMalloc Error

 Keywords:  ArrayFileGet ArrayFileGetCsv FileRead VMalloc Error VirtualAlloc Failed IntControl 65

---

Question:

Script is choking on the ArrayFileGet. Error reported is "VMalloc error - VirtualAlloc failed", and that box has the number 487 on it. I'm running XP with 4 GB RAM, using Winbatch 2005C. (Older version but good one.)

File size: 199,252,976 bytes (200MB). Admittedly large. 2,735,193 lines in it. All the lines are < 300 bytes.

Script that now bombs was executing fine, until just recently. The data file has gradually grown.

Is there a known limit for parsing a file into strings using ArrayFileGet? If so, does a newer version of Winbatch not have whatever wall I'm hitting?

Answer:

You are running out of string memory. You should be using a database like sqlite or partitioning the file into smaller, more manageable, chunks with the binary file functions. I wont go into a protracted explanation of process memory limits and string allocation but files of that size are beyond the scope of 'ArrayFileGet'. We can't tell you exactly what the maximum file size is for the function because there are too many variables and the limit changes based on those variables.

In short it isn't the number of lines/strings that is causing your script to run out of string memory. It is the combined size (sum of the lengths times the size of a character) of all the strings that is causing your script to run out of string memory.

The error you are receiving only occurs when reserved memory for strings is exhausted.

---

Article ID:   W17654

Filename:   ArrayFileGet VMalloc Error.txt

File Created: 2013:03:01:09:17:48

Last Updated: 2013:03:01:09:17:48