Split the massive array object into more manageable chunks

Question

Split the massive array object into more manageable chunks

I have a large array that can range from 1 to 600K records. To work with this big array, I need to break it into smaller chunks to carry out operations.

How can I achieve this effectively?

Here is my proposed solution: The challenge I am facing is not knowing the exact number of elements in the array, making it difficult to determine the chunk size by dividing it into ten parts.

for(let i = 0; i < largeArray.length; i += largeArray.length/10) {
   var chunk = largeArray.slice(i, what_is_the_chunk_size);
}

angular typescript

Answer 1

Answer №1

If you're looking to split an array into chunks based on a specific size, this function is just what you need. It will create an array of arrays with each chunk containing the specified number of elements.

function splitArrayIntoChunks(array, chunkSize) {
  const size = chunkSize || 10;

  const chunkedArray = array.reduce((acc, item) => {
    let group = acc.pop();

    if (group.length === size) {
      acc.push(group);
      group = [];
    }

    group.push(item);

    acc.push(group);
    return acc;
  }, [[]]);

  return chunkedArray;
}

Answer 2

If you're looking to split an array into chunks based on a specific size, this function is just what you need. It will create an array of arrays with each chunk containing the specified number of elements.

function splitArrayIntoChunks(array, chunkSize) {
  const size = chunkSize || 10;

  const chunkedArray = array.reduce((acc, item) => {
    let group = acc.pop();

    if (group.length === size) {
      acc.push(group);
      group = [];
    }

    group.push(item);

    acc.push(group);
    return acc;
  }, [[]]);

  return chunkedArray;
}

Answer 3

Answer №2

Does this code look familiar?

import { from } from 'rxjs';
import { skip, take } from 'rxjs/operators';

const source = from(array);

const result = source.pipe(
  skip(10 * i),
  take(10)
);

Answer 4

Does this code look familiar?

import { from } from 'rxjs';
import { skip, take } from 'rxjs/operators';

const source = from(array);

const result = source.pipe(
  skip(10 * i),
  take(10)
);

Answer 5

Answer №3

Utilize the method Array.prototype.reduce. You can even expand that prototype to divide by a specific number:

Array.prototype.splitBy = function(size) {
  return this.reduce((p, n) => {
    if (p[p.length - 1].length < size) p[p.length - 1].push(n);
    else p.push([n]);
    return p;
  }, [[]]);
}

const data = new Array(500).fill(0).map((v, i) => i);

const splitted = data.splitBy(10);

console.log(splitted);
console.log('Size of splitted array = ', splitted.length);

Answer 6

Utilize the method Array.prototype.reduce. You can even expand that prototype to divide by a specific number:

Array.prototype.splitBy = function(size) {
  return this.reduce((p, n) => {
    if (p[p.length - 1].length < size) p[p.length - 1].push(n);
    else p.push([n]);
    return p;
  }, [[]]);
}

const data = new Array(500).fill(0).map((v, i) => i);

const splitted = data.splitBy(10);

console.log(splitted);
console.log('Size of splitted array = ', splitted.length);

Answer 7

Answer №4

I personally prefer this option because of its simplicity and cleanliness.

Originally sourced from this link

var size = 3; var arrayOfArrays = [1,2,3,4,5,6,7,8,9,10];

for (var i=0; i < arrayOfArrays.length; i+=size ) {
     var chunckedArray = arrayOfArrays.slice(i,i+size);
     console.log(chunckedArray); 

     for(var j = 0; j < chunckedArray.length; j++)
     {
       console.log(chunckedArray[j]); // Perform operations
     }   
}

Answer 8

I personally prefer this option because of its simplicity and cleanliness.

Originally sourced from this link

var size = 3; var arrayOfArrays = [1,2,3,4,5,6,7,8,9,10];

for (var i=0; i < arrayOfArrays.length; i+=size ) {
     var chunckedArray = arrayOfArrays.slice(i,i+size);
     console.log(chunckedArray); 

     for(var j = 0; j < chunckedArray.length; j++)
     {
       console.log(chunckedArray[j]); // Perform operations
     }   
}

Split the massive array object into more manageable chunks

Answer №1

Answer №2

Answer №3

Answer №4

Similar questions

The Angular 2 view will remain unchanged until the user interacts with a different input box

Angular2 components or module npm packages offer a wide range of functionality and

The category has been defined but remains inaccessible. What could be the reason for this limitation?

Connecting the Telegram web app to Angular is a simple process that involves integrating the

Navigating through an array's contents with RxJs

The Angular application is not functioning properly after running npm start, even though all the necessary packages have

What is the reason for Google Chrome extension popup HTML automatically adding background.js and content.js files?

Convert checkbox choices to strings stored in an array within an object

Is it possible to convert several XLIFF files of different languages into JSON files using Angular?

Tips for organizing MUI Card effectively within a React application using TypeScript

What is the best way to invoke a function using a string as its name?

Issues with implementing AddEventListener in InAppBrowser on IONIC 2

Issues with toggling the menu on Angular 14 using Bootstrap 4.6

Is there a more concise method for accepting a collection of interfaces in TypeScript?

Revamping the static method signature of a class in Typescript

Struggling with object type casting in Typescript

Adjust the height, width, and color of the "kendo-switch" widget

Is there a way to determine if two distinct selectors are targeting the same element on a webpage?

Encountering issues with Socket.io: consistently experiencing websocket connection failures along with persistent 404 errors on the

What is the process for including a unique attribute for child elements within a React component using TypeScript?