[Migration\Exception] - Integrity Check failed 1.9.2.2 -> CE 2.0.0 #19

quynhvv · 2015-12-11T04:21:41Z

Hi guys,

I have following the guide to use this tool at
http://devdocs.magento.com/guides/v2.0/migration/migration-migrate.html

I have finished the "Migrate settings" step

Command was run:

php -f /home/qvv/www/_shared/mage2/ce-200-dev/bin/magento migrate:settings -r /home/qvv/www/_shared/mage2/ce-200-dev/vendor/magento/data-migration-tool/etc/ce-to-ce/1.9.2.2/config.xml

But the tool get errors at "Migrate data" step as the screenshots:

Command was run:

php -f /home/qvv/www/_shared/mage2/ce-200-dev/bin/magento migrate:data /home/qvv/www/_shared/mage2/ce-200-dev/vendor/magento/data-migration-tool/etc/ce-to-ce/1.9.2.2/config.xml

and

Only websites, stores and some configs data was migrated to Magento 2 and no more.

and i can't finished the data migration on this step

Any ideas to solve that issues?

Thanks.

The text was updated successfully, but these errors were encountered:

Vincenkt · 2015-12-11T06:42:58Z

Hi quynhvv,
To solve this issue, please add tables and fields are missing to tag in map file.

quynhvv · 2015-12-11T08:05:10Z

@Vincenkt:
What is the map file name, i have to add the missing documents and fields?
I have tried one add to the file vendor/magento/data-migration-tool/etc/ce-to-ce/1.9.2.2/map.xml the missing Document: customer_eav_attribute. Fields: is_used_for_customer_segment
and re-run the migrate command to test but it still get that errors.
Any ideas for me?
Thanks

yaronish · 2015-12-11T08:53:58Z

@quynhvv
By default map file for EAV Step is vendor/magento/data-migration-tool/etc/ce-to-ce/map-eav.xml.dist

quynhvv · 2015-12-11T09:01:22Z

@yaronish:
Thanks for your reply, i see that file and i have the vendor/magento/data-migration-tool/etc/ce-to-ce/map-eav.xml

But, i don't know how to edit this file to solve my above issues.
I don't see any detail guide from Magento for this case.
Can you show me how to edit this?

Thanks.

yaronish · 2015-12-11T09:09:15Z

In case you do not need migrate this column just add next to map-eav.xml file under map/source/field_rules:

            <ignore>
                <field>customer_eav_attribute.is_used_for_customer_segment</field>
            </ignore>

Also additional information about how to configure Data Migration Tool you can find here:
http://devdocs.magento.com/guides/v2.0/migration/migration-tool-configure.html
and here:
http://devdocs.magento.com/guides/v2.0/migration/migration-tool-internal-spec.html

quynhvv · 2015-12-11T09:43:12Z

@yaronish:
In my case, i have this config:

But it still get this errors:

Please help!
Thanks.

yaronish · 2015-12-11T09:49:35Z

From documentation I've specified (http://devdocs.magento.com/guides/v2.0/migration/migration-tool-configure.html):
map-eav.xml.dist - Map file that is used in EAV Step.
map.xml.dist - Mapping file required for the map step.

You have fixed EAV Step already.
Problems that still exists are connected to Map Step and you have to work with vendor/magento/data-migration-tool/etc/ce-to-ce/1.9.2.2/map.xml

quynhvv · 2015-12-11T10:04:43Z

@yaronish:
Yes, i see, thanks for your reply.
But i don't know why we have to do this manual step by step in along time when Magento was released for each version of Magetno1 :-s

Thanks.

yaronish · 2015-12-11T10:12:28Z

You have not default M1 installation. I can suppose you are using Sample Data for M1 and it changes your M1 database.

quynhvv · 2015-12-11T10:24:27Z

@yaronish:
Please not that, i am using the Data Sample Edition downloaded from Magento.com ;)
and install it for Magento 1.9.2.2

Thanks.

zin-mi · 2015-12-17T09:10:23Z

@yaronish:
I have complete all step but still have exception with the message like this
http://prntscr.com/9f6stf
Please tell me how to resolve it?
Thanks.

yaronish · 2015-12-17T09:24:55Z

@zivendesign
Did you check your migration log file?

zin-mi · 2015-12-17T09:27:14Z

@yaronish:
Please let me know which the file and the place?
Thanks

zin-mi · 2015-12-17T09:29:54Z

Here in the my log:

[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: EAV Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: Customer Attributes Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: Map Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: Url Rewrite Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: Log Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: Ratings Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: ConfigurablePrices step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: OrderGrids Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: Tier Price Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: SalesIncrement Step]: started

Everything fine but still have the Issue like the image http://prntscr.com/9f6stf

yaronish · 2015-12-17T09:38:44Z

@zivendesign

Put next code inside this method before existing code: \Migration\Step\SalesIncrement\Integrity::checkForErrors

        var_dump($this->missingDocumentFields);
        var_dump($this->missingDocuments);

zin-mi · 2015-12-17T09:44:48Z

@yaronish:
here: http://prntscr.com/9f73wr
But still like

[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: EAV Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: Customer Attributes Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: Map Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: Url Rewrite Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: Log Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: Ratings Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: ConfigurablePrices step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: OrderGrids Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: Tier Price Step]: started
[2015-12-17 09:29:15][INFO][mode: data][stage: integrity check][step: SalesIncrement Step]: started

Everything fine but still have the Issue like the image http://prntscr.com/9f6stf

victor-v-rad · 2015-12-17T09:46:17Z

Try to run the migration with -vvv option like this:
php bin/magento migrate:data /var/www/magento2/vendor/magento/data-migration-tool/etc/ce-to-ce/1.9.2.1/config.xml -vvv
it should show the trace of the error

yaronish · 2015-12-17T09:46:49Z

Code after return statement is always ignored.
Please do in next way:

    protected function checkForErrors()
    {
        var_dump($this->missingDocumentFields);
        var_dump($this->missingDocuments);

        $checkMissingDocuments = $this->checkMissingDocuments();
        $checkMissingDocumentFields = $this->checkMissingDocumentFields();
        return $checkMissingDocuments && $checkMissingDocumentFields;
    }

zin-mi · 2015-12-17T09:48:45Z

@yaronish:
It's show http://prntscr.com/9f74yt but the product still not yet to MAgento 2

yaronish · 2015-12-17T09:52:23Z

@zivendesign
On the last screenshot settings migration is shown but original question is about data migration.

zin-mi · 2015-12-17T09:53:42Z

Here my show error: http://prntscr.com/9f76ti

victor-v-rad · 2015-12-17T10:01:52Z

The latest screenshot does not show information after the error "Integrity Check failed". It should show trace information

zin-mi · 2015-12-17T10:05:15Z

Here the code like @yaronish suggest: http://prntscr.com/9f7a4n and when i'm run the command like you suggest: php bin/magento migrate:data /var/www/magento2/vendor/magento/data-migration-tool/etc/ce-to-ce/1.9.2.1/config.xml -vvv and it show up http://prntscr.com/9f7aj2

so please tell me next stepp @victor-v-rad

yaronish · 2015-12-17T10:08:10Z

@zivendesign

why on screenshot is migrate:settings? please run migrate:data instead.

zin-mi · 2015-12-17T10:11:30Z

Sorry @yaronish misstake here the issue: http://prntscr.com/9f7cld

yaronish · 2015-12-17T11:09:29Z

@zivendesign
What I see - there is not problems with SalesIncrement step but looks like one of previous steps has it.
I see that Map Step has warnings but warnings do not stop migration.
So I want ask you run next command again and show screen for whole migration log.

php bin/magento migrate:data /var/www/magento2/vendor/magento/data-migration-tool/etc/ce-to-ce/1.9.2.1/config.xml -vvv

Thanks.

bh-ref · 2015-12-17T12:28:19Z

@yaronish I had the same problem, see #15 (comment) and the posts below.

I do not know your exact problem, but if you make these changes it may work: https://github.com/magento/data-migration-tool-ce/pull/25/files

bh-ref · 2015-12-17T12:44:41Z

@yaronish If you want to find out, which step is causing the problem, the following code should work:

Locate the file vendor/magento/data-migration-tool/src/Migration/Mode/Data.php, go to method runIntegrity (Line 83) and edit it to the following:

protected function runIntegrity(StepList $steps)
    {
        $result = true;
        foreach ($steps->getSteps() as $stepName => $step) {
            if (!empty($step['integrity'])) {
                $currentStepResult = $this->runStage($step['integrity'], $stepName, 'integrity check');

                if (!$currentStepResult)
                    echo('There was an error in Step ' . $stepName);

                $result = $currentStepResult && $result;
            }
        }
        if (!$result) {
            throw new Exception('Integrity Check failed');
        }
    }

Now it should output which step generated the error.

zin-mi · 2015-12-18T03:44:23Z

@yaronish:
I'm made like you suggest and still see this: http://prntscr.com/9fjdhh
Please help me.
Thanks.

victor-v-rad · 2015-12-18T14:55:33Z

Ok. It seems deeper debugging required here. My skype: rad_victor. Let's chat there.

victor-v-rad · 2015-12-19T13:05:47Z

@bh-ref
@zivendesign

I would also propose to make a dump of your mysql db schema (without data) of Magento 1 and Magento 2 and send it to me. So I could run the migration and see where is the problem.

zin-mi · 2015-12-22T09:12:24Z

Hi @victor-v-rad,
Here the data from me please help me and tell me how to resolve the issue.

https://www.dropbox.com/s/smdg1nn6ywf9yaw/mag1.zip?dl=0

Thanks

victor-v-rad · 2015-12-22T10:54:06Z

Hi @zivendesign
This fix
https://github.com/magento/data-migration-tool-ce/pull/25/files
should resolve your issue

mreichh · 2015-12-29T21:26:29Z

fix works like a charme. Thanks for that!

bh-ref · 2015-12-30T08:55:42Z

@mreichh you're welcome :) I hop the fix / pull request will soon be accepted, it seems like it affects quite a lot migrations

ilol · 2016-01-06T13:19:24Z

Great, @quynhvv would you close the issue?

lalitmalav · 2016-08-24T09:49:42Z

Has resolved this issue ?? ....i am facing this issue Please Help !! also I have tried all thing which was discussed above.....

pt-p3 · 2017-02-16T14:19:52Z

Hi,

I have also the same error, after running the migration: data command, it stuck at the salesIncrement attached the screenshot, I have EE 1.13.Magento 2.1.3

I have followed the above steps but error still exist, Any solution really appreciate

Thanks

raminfobeans · 2017-03-23T08:39:11Z

add

customer_eav_attribute.is_used_for_customer_segment in vendor/magento/data-migration-tool/etc/ce-to-ce/map-eav.xml.dist

routbiplab · 2018-01-02T14:03:12Z

I am facing the same issue during data migrate from 1.9.3.2 to 2.1.9

[2018-01-02 14:01:00][INFO][mode: data][stage: integrity check][step: SalesIncrement Step]: started

[Migration\Exception]
Integrity Check failed

bh-ref mentioned this issue Dec 22, 2015

[Migration\Exception] Integrity Check failed #15

Closed

quynhvv closed this as completed Jan 6, 2016

vcpawate mentioned this issue Jan 11, 2016

[Migration\Exception] - Integrity Check failed 1.9.0.1 -> CE 2.0.0 #47

Closed

quangdog mentioned this issue Jan 12, 2016

No Customers Visible In Admin Backend After Migration #43

Closed

ghost mentioned this issue Jun 2, 2016

Class does not exist error when viewing/adding customer record in admin #93

Closed

onepack mentioned this issue Aug 4, 2016

Categories broken after migration 1.9.2.2 to 2.1.0 #130

Closed

robinmaster mentioned this issue Jun 2, 2017

After data migration we have issue with Base table or view not found: 1146 Table 'magento2.customer/entity' doesn't exist #313

Closed

This was referenced Jun 16, 2017

After migrate: Error 500 when accessing Customers > All customers #321

Closed

After migrate: "Asymmetric transaction rollback" error on product save #322

Closed

redfishstix mentioned this issue Jul 2, 2017

Migrating from 1.9.2.0 to Magento 2.1.7: attributeSetId no such entity #324

Closed

expertalex mentioned this issue Oct 23, 2017

Migrating Store Views form Magento 1.9.1 to Magento 2.2 #396

Closed

niners52 mentioned this issue May 14, 2018

Magento 1.9.3.1 to Magento 2.2.3 #491

Closed

srinivasnovamodule mentioned this issue Jun 4, 2018

Getting error when edit the configurable product on Magento 2.2.4 after migration #527

Closed

Naberdz mentioned this issue May 21, 2019

Requested store id was not found #689

Closed

kenchan-plp mentioned this issue Mar 11, 2024

Customer Login get the Error: Call to a member function getId() on null in vendor\magento\data-migration-tool\src\Migration\Model\PasswordHashResolver.php:44 #922

Open

[Migration\Exception] - Integrity Check failed 1.9.2.2 -> CE 2.0.0 #19

[Migration\Exception] - Integrity Check failed 1.9.2.2 -> CE 2.0.0 #19

Comments

quynhvv commented Dec 11, 2015

Vincenkt commented Dec 11, 2015

quynhvv commented Dec 11, 2015

yaronish commented Dec 11, 2015

quynhvv commented Dec 11, 2015

yaronish commented Dec 11, 2015

quynhvv commented Dec 11, 2015

yaronish commented Dec 11, 2015

quynhvv commented Dec 11, 2015

yaronish commented Dec 11, 2015

quynhvv commented Dec 11, 2015

zin-mi commented Dec 17, 2015

yaronish commented Dec 17, 2015

zin-mi commented Dec 17, 2015

zin-mi commented Dec 17, 2015

yaronish commented Dec 17, 2015

zin-mi commented Dec 17, 2015

victor-v-rad commented Dec 17, 2015

yaronish commented Dec 17, 2015

zin-mi commented Dec 17, 2015

yaronish commented Dec 17, 2015

zin-mi commented Dec 17, 2015

victor-v-rad commented Dec 17, 2015

zin-mi commented Dec 17, 2015

yaronish commented Dec 17, 2015

zin-mi commented Dec 17, 2015

yaronish commented Dec 17, 2015

bh-ref commented Dec 17, 2015

bh-ref commented Dec 17, 2015

zin-mi commented Dec 18, 2015

victor-v-rad commented Dec 18, 2015

victor-v-rad commented Dec 19, 2015

zin-mi commented Dec 22, 2015

victor-v-rad commented Dec 22, 2015

mreichh commented Dec 29, 2015

bh-ref commented Dec 30, 2015

ilol commented Jan 6, 2016

lalitmalav commented Aug 24, 2016 • edited Loading

pt-p3 commented Feb 16, 2017

raminfobeans commented Mar 23, 2017

routbiplab commented Jan 2, 2018 • edited Loading

lalitmalav commented Aug 24, 2016 •

edited

Loading

routbiplab commented Jan 2, 2018 •

edited

Loading