Rest api error when trying to insert 4000 items

Question

I am trying to insert 4000 items to the list , after inserting 1500 (around) following error occurred (forbidden 403).

<html>
<head>
 <script src="/Shared Documents/jquery-3.2.1.js"></script>
 <script src="/Shared Documents/xlsx.core.min.js"></script>
<script>
function AddItems()
{
var digest = "";
$.ajax(
{
                url: "/_api/contextinfo",
                method: "POST",
                headers: {
                                "ACCEPT": "application/json;odata=verbose",
                                "content-type": "application/json;odata=verbose"
                },
                success: function (data) {
                digest = data.d.GetContextWebInformation.FormDigestValue;
                },
                error: function (data) {

                }
}).done(function() {


    var fileInput = $("#uploadFile")[0].files;
    for (var i = 0; i < fileInput.length; i++) 
    {
        (function(file) 
       { 
        var reader = new FileReader();
                var name = file.name;
                reader.onload = function (e) {
                var data = e.target.result;

                var result;
                var workbook = XLSX.read(data, { type: 'binary' });

                var sheet_name_list = workbook.SheetNames;
                sheet_name_list.forEach(function (y) { /* iterate through sheets */
                    //Convert the cell value to Json

                        var sheet= XLSX.utils.sheet_to_json(workbook.Sheets[y]);
            sheet.forEach(function(row){


                var siteUrl = _spPageContextInfo.webAbsoluteUrl;
                     $.ajax({
                            url: siteUrl + "/_api/web/lists/GetByTitle('Emp')/items",
                            method: "POST",
                    async: false,
                            data: JSON.stringify({
                                    '__metadata': { 'type': 'SP.Data.EmpListItem' },
                                    'Title': row.Title,
                        'EmpName':row.Name,
                        'Designation':row.Designation

                            }),
                            headers: {
                                // "X-HTTP-Method":"MERGE",
                                "accept": "application/json;odata=verbose",
                            "content-type": "application/json;odata=verbose",
                                "X-RequestDigest": digest
                            },
                            success: function(data) {

                            },
                            error: function (err) {
                                        alert("error");
                                        alert(JSON.stringify(err));
                            }
                         });


            });

                });

            };
            reader.readAsArrayBuffer(file);


       })(fileInput[i]);          
    } 
});                           
}


</script>

</head>
<body>
<div>
                <input id="uploadFile" type="file" multiple="multiple">
</div>

<div style:"margin-top:10px">
                <input type="submit" onclick="AddItems()" value="Insert"> </input>
</div>


</body>
</html>

Are you running this against SharePoine Online or on-premise? — Thomas Gass, Jul 25 '17 at 11:21
Might be a long shot but it could be the List Item View Threshold being hard-set at 5000 for SPO, though I doubt this would affect REST. Try inserting 3000 items when it already has 1500 (thus keeping it below 5000), if that works the threshold may be the problem. — Thomas Gass, Jul 28 '17 at 13:24

score 2 · Answer 1 · answered Jul 25 '17 at 16:51

For insert bulk items to SP List, you should consider about times out of your request. The default query request times out is 30000 milliseconds

You can use the approach below:

Sample GET request

http:// server/_api/search/query?querytext='sharepoint'&timeout=60000

Sample POST request

{
     '__metadata':{'type':'Microsoft.Office.Server.Search.REST.SearchRequest'},
     'Querytext':'sharepoint',
     'Timeout'='60000'
}

Reference:

https://dev.office.com/sharepoint/docs/general-development/sharepoint-search-rest-api-overview

score 0 · Answer 2 · answered Jul 25 '17 at 15:43

As you can see in the error message, it has to do with security validation of the page. Since you are doing a bulk update, I believe it takes considerable amount of time to finish the updates and thus in between itself the form digest for the page expires.

Please refer the below links -

Security Validation Issue - Stack Overflow

Explaination on page time out issue- MSDN

Rest api error when trying to insert 4000 items

2 Answers2