{"revision":"c10276e953456835cdbb1f3a60d58ae1980be353","document":{"id":45231,"path":"security-management/sem-migration-prereq-reference-data.md","title":"Migration upgrade reference information","bundle":null,"doc_type":null,"release":"australia","body":"\n# Migration upgrade reference information\n\nLists and tables of scheduled jobs, table deprecations, and new columns added to existing tables for migration to Security Exposure Management Workspace.\n\n## Scheduled jobs\n\nDeactivate the scheduled jobs and scheduled jobs within integration-specific scopes for the Vulnerability Response, Application Vulnerability Response, Container Vulnerability Response, and Configuration Compliance applications.\n\n- Adding vulnerability and test fields for remediation tasks\n- Associate existing AVIs with Auto Exception Rule\n- Associate existing VIs with Auto Exception Rule\n- Calculate Related VI Counts for Application Remediation Task\n- Calculate Related VI Counts for Remediation Task\n- Calculate Related VI Counts for Vulnerabilities\n- Check Risk Mitigation Expiration\n- Check Vulnerable Item and Groups Deferment Expiration\n- Copy customized request exception questionnaire to compensating control\n- Evaluate remediation targets\n- Generate remediation digest\n- Insert classic Remediation tasks Into Unified Remediation Task\n- Migrate the background jobs\n- Populate Approval Source\n- Populate CC Number, Configuration Item and Business criticality into Unified Remediation Task Table\n- Populate Container Number,Configuration and Business criticality into Unified Remediation Task Table\n- Populate risk fields for risk rules\n- Populate Vulnerable CIs table - Delete and Re-populate\n- Populate Vulnerable CIs table - Delete and Re-populate for Test Results\n- Populate Vulnerable CIs table - from Vulnerable CI manifest table\n- Re-open deferred remediation tasks\n- Reapply all vulnerability assignment rules\n- Reassignment count for assignment rules\n- Refresh and resolve duplicate VITs on remediation task\n- Refresh associated Application vulnerable items for non-VGR based VG\n- Refresh associated vulnerable items for non-VGR based VG\n- Remove Duplicate VI Remediation Status\n- Repair erroneous Vulnerable Items Last Opened and Closed\n- Rerun calculators\n- Rolldown state from vulnerability group to vulnerable item\n- Rolldown until date from vulnerability group to vulnerable item\n- Rollup application vulnerable item values to vulnerability and group\n- Rollup VI values to vulnerability, Remediation Task \\(RT\\), and VI count on RT\n- Run severity calculator after vuln entry promotion\n- Send unassignment notification\n- Set deferral counts\n- Set related CI services for VI\n- Update age closed for VITs and AVITs\n- Update all old tags to remediation task table\n- Update is\\_in\\_group on Vulnerable Items\n- Update Last Open Detection Value To VITs\n- Update Remediation tasks with rolled up states\\(AVR\\)\n- Update Remediation tasks with rolled up states\\(VR\\)\n- Update risk rating for vulnerability solutions\n- Update Ungrouped Vulnerable Items\n- Update Vulnerability on VG\n- Vulnerability Response Age Closed Update\n- Vulnerability Response CI count\n- Vulnerability Response Risk and Remediation Status Upgrade\n- Add default values for last\\_opened\\_dt\\_tm from last\\_opened\n- Adding TR's CIs to service m2m table\n- Associate existing Container VIs with Auto Exception Rule\n- Associate existing TRs with Auto Exception Rule\n- Auto-close Rule Processor\n- Auto-Close Stale Test Results\n- Calculate Business Criticality for CVIT\n- Calculate Related CVIT Counts for Vulnerabilities\n- Calculate Related VI Counts for Container Remediation Task\n- Calculate remediation metrics for all the remediation tasks\n- Calculate remediation metrics for all the tests\n- Check Container Vulnerable Item Deferment Expiration\n- Check Remediation Tasks and Test Result Deferment Expiration\n- Delete inactive groupBys\n- Evaluate and notify remediation targets\n- Insert Remediation Tasks Into Unified Remediation Task\n- Populate existing test result fields\n- Process test result manifest records\n- Re-apply CI Lookup Rules on the Changed Discovered items\n- Reapply all assignment rules\n- Reapply CI lookup rules\n- Reassess the state of the remediation tasks\n- Reassignment count for assignment rules - CC\n- Reconcile unmatched discovered items\n- Refresh App related Saved filters\n- Refresh CC related Saved filters\n- Refresh Container related Saved filters\n- Refresh Host related Saved filters\n- Remove Groups from Exception Rules\n- Rollup container vulnerable item values to vulnerability and group\n- Rollup Risk scores to Organization\n- Rollup test result values to remediation task and configuration test\n- Send unassignment notification - CC\n- Set deferral counts\n- Trigger aggregation creation and running for saved filter\n- Update age closed for CC\n- Update age closed for CVITs\n- Update all old tags to compliance remediation task table\n- Update all old tags to container remediation task table\n- Update Awaiting Implementation state on CVITs\n- Update remediation metrics\n- Update remediation status for stale test results\n- Update Remediation tasks with rolled up states \\(CC\\)\n- Update Remediation tasks with rolled up states \\(CVR\\)\n- Update Risk Rating for Test Results\n- Update Rollup risk score for all non closed Result groups and Configuration tests\n- Update Saved Filter Aggregations\n- Vulnerability Response Container Count\n\nUSEM Data Model changes.\n\n\n
\n\nDeprecated tables\n\n\n\nNew tables\n\n
\n\nVulnerability Assignment Rule \\(sn\\_vul\\_assignment\\_rule\\)\n\n\n\nAssignment Rule \\(sn\\_sec\\_wf\\_assign\\_rule\\)\n\n
\n\nSecurity Classification Group \\(sn\\_sec\\_cmn\\_classification\\_group\\)\n\n Classification Group \\(sn\\_vul\\_classification\\_group\\)\n\n\n\nClassification Group \\(sn\\_sec\\_wf\\_classification\\_group\\)\n\n
\n\nSecurity Classification Rule \\(sn\\_sec\\_cmn\\_classification\\_rule\\)\n\n Classification Rule \\(sn\\_vul\\_classification\\_rule\\)\n\n\n\nClassification Rule \\(sn\\_sec\\_wf\\_classification\\_rule\\)\n\n
\n\nSecurity Calculator Group \\(sn\\_sec\\_cmn\\_calculator\\_group\\)\n\n Vulnerability Calculator \\(sn\\_vul\\_calculator\\_group\\)\n\n\n\nRisk Calculator \\(sn\\_sec\\_calculator\\_group\\)\n\n
\n\nSecurity Calculator \\(sn\\_sec\\_cmn\\_calculator\\)\n\n Vulnerability Calculator Rule \\(sn\\_vul\\_calculator\\)\n\n Vulnerability Risk Rule \\(sn\\_vul\\_calc\\_risk\\)\n\n\n\nRisk Calculator Rule \\(sn\\_sec\\_calculator\\_rule\\)\n\n
\n\nRisk rule field \\(sn\\_vul\\_risk\\_field\\)\n\n\n\nRisk rule field \\(sn\\_sec\\_calculator\\_risk\\_field\\)\n\n
\n\nVulnerability Remediation Status \\(sn\\_vul\\_m2m\\_ttr\\_status\\)\n\n\n\nRemediation Status\n\n \\(sn\\_sec\\_wf\\_m2m\\_ttr\\_status\\)\n\n
\n\nRemediation Target Rule \\(sn\\_vul\\_ttr\\_rule\\)\n\n\n\nRemediation Target Rules \\(sn\\_sec\\_wf\\_ttr\\_rule\\)\n\n
\n\nVulnerability Rollup Calculators \\(sn\\_vul\\_rollup\\)\n\n\n\nRollup config \\(sn\\_sec\\_wf\\_rollup\\_config\\)\n\n
\n\nRemediation Task Rule \\(sn\\_vul\\_grouping\\_rule\\)\n\n Remediation Task Rule \\(sn\\_vulc\\_grouping\\_rule\\)\n\n\n\nRemediation Task Rule \\(sn\\_sec\\_rem\\_task\\_rule\\)\n\n
\n\nException Rule \\(sn\\_vul\\_auto\\_exception\\_rule\\)\n\n Auto Exception Rules \\(sn\\_vulc\\_auto\\_exception\\_rule\\)\n\n\n\nException Rules \\(sn\\_sec\\_exception\\_rule\\)\n\n
\n\nVulnerability State Change Approval \\(sn\\_vul\\_change\\_approval\\)\n\n State Change Approval \\(sn\\_vulc\\_state\\_change\\_approval\\)\n\n\n\nChange Approval \\(sn\\_sec\\_exception\\_change\\_approval\\)\n\n
\n\nException Management Configuration \\(sn\\_vul\\_exception\\_config\\)\n\n Exception Management Configuration \\(sn\\_sec\\_cmn\\_exception\\_config\\)\n\n\n\nException Management Configuration \\(sn\\_sec\\_exception\\_config\\)\n\n
\n\nPolicy Exception Reason Mapping \\(sn\\_sec\\_cmn\\_policy\\_reason\\_mapping\\)\n\n Policy Exception Reason Mapping \\(sn\\_vul\\_policy\\_reason\\_mapping\\)\n\n\n\nPolicy Exception Reason Mapping \\(sn\\_sec\\_exception\\_policy\\_reason\\_mapping\\)\n\n
\n\nQuestionnaire Configuration \\(sn\\_sec\\_cmn\\_questionnaire\\_config\\)\n\n\n\nQuestionnaire Configuration \\(sn\\_sec\\_exception\\_questionnaire\\_config\\)\n\n
\n\nVulnerability Compensating Control relationship \\(sn\\_vul\\_m2m\\_entry\\_compensating\\_control\\)\n\n\n\nVulnerability Compensating Control relationship \\(sn\\_vul\\_cmn\\_m2m\\_entry\\_compensating\\_control\\)\n\n
## New tables introduced to unify administration features\n\n- Assignment Rule \\(sn\\_sec\\_wf\\_assign\\_rule\\)\n- Classification Group \\(sn\\_sec\\_wf\\_classification\\_group\\)\n- Classification Rule \\(sn\\_sec\\_wf\\_classification\\_rule\\)\n- Risk Calculator \\(sn\\_sec\\_calculator\\_group\\)\n- Risk Calculator Rule \\(sn\\_sec\\_calculator\\_rule\\)\n- Risk rule field \\(sn\\_sec\\_calculator\\_risk\\_field\\)\n- Remediation Target Rules \\(sn\\_sec\\_wf\\_ttr\\_rule\\)\n- Rollup config \\(sn\\_sec\\_wf\\_rollup\\_config\\)\n- Approval configuration \\(sn\\_sec\\_cmn\\_approval\\_config\\)\n- Approver level \\(sn\\_sec\\_cmn\\_approver\\_level\\)\n- Remediation Task Rule \\(sn\\_sec\\_rem\\_task\\_rule\\)\n- Auto-close Rule \\(sn\\_vul\\_cmn\\_auto\\_close\\_rule\\)\n- Exception Rules \\(sn\\_sec\\_exception\\_rule\\)\n- Change Approval \\(sn\\_sec\\_exception\\_change\\_approval\\)\n- Exception Management Configuration \\(sn\\_sec\\_exception\\_config\\)\n- Policy Exception Reason Mapping \\(sn\\_sec\\_exception\\_policy\\_reason\\_mapping\\)\n- Questionnaire Configuration \\(sn\\_sec\\_exception\\_questionnaire\\_config\\)\n- Vulnerability Compensating Control relationship \\(sn\\_vul\\_cmn\\_m2m\\_entry\\_compensating\\_control\\)\n- Widget Grouping \\(sn\\_sec\\_sem\\_widget\\_grouping\\)\n- Widget Aggregation \\(sn\\_sec\\_sem\\_m2m\\_widget\\_dashboard\\)\n- Dashboard \\(sn\\_sec\\_sem\\_dashboard\\)\n- Dashboard Widgets \\(sn\\_sec\\_sem\\_dashboard\\_widgets\\)\n\n## Security Support Common deprecated tables\n\n- Security Calculator Group \\(sn\\_sec\\_cmn\\_calculator\\_group\\)\n- Security Calculator \\(sn\\_sec\\_cmn\\_calculator\\)\n- Security Classification Group \\(sn\\_sec\\_cmn\\_classification\\_group\\)\n- Security Classification Rule \\(sn\\_sec\\_cmn\\_classification\\_rule\\)\n- Policy Exception Reason Mapping \\(sn\\_sec\\_cmn\\_policy\\_reason\\_mapping\\)\n\n## Vulnerability Response deprecated tables\n\n- Vulnerability Assignment Rule \\(sn\\_vul\\_assignment\\_rule\\)\n- Vulnerability Calculator \\(sn\\_vul\\_calculator\\_group\\)\n- Vulnerability Calculator Rule \\(sn\\_vul\\_calculator\\)\n- Vulnerability Risk Rule \\(sn\\_vul\\_calc\\_risk\\)\n- Risk rule field \\(sn\\_vul\\_risk\\_field\\)\n- Classification Group \\(sn\\_vul\\_classification\\_group\\)\n- Classification Rule \\(sn\\_vul\\_classification\\_rule\\)\n- Vulnerability Remediation Status \\(sn\\_vul\\_m2m\\_ttr\\_status\\)\n- Remediation Target Rule \\(sn\\_vul\\_ttr\\_rule\\)\n- Vulnerability Rollup Calculators \\(sn\\_vul\\_rollup\\)\n- Exception Rule \\(sn\\_vul\\_auto\\_exception\\_rule\\)\n- Vulnerability State Change Approval \\(sn\\_vul\\_change\\_approval\\)\n- Exception Management Configuration \\(sn\\_vul\\_exception\\_config\\)\n- Vulnerability Compensating Control relationship \\(sn\\_vul\\_m2m\\_entry\\_compensating\\_control\\)\n- Policy Exception Reason Mapping \\(sn\\_vul\\_policy\\_reason\\_mapping\\)\n\n## Vulnerability Response common workspace deprecated table\n\nSaved Filters \\(sn\\_vul\\_cmn\\_ws\\_saved\\_filter\\)\n\n## Configuration Compliance deprecated tables\n\n- Auto Exception Rules \\(sn\\_vulc\\_auto\\_exception\\_rule\\)\n- State Change Approval \\(sn\\_vulc\\_state\\_change\\_approval\\)\n\n## New columns introduced in findings tables\n\nVulnerable Item \\[sn\\_vul\\_vulnerable\\_item\\] table.\n\n- remediation\\_plan\n- remediation\\_commitment\\_dt\\_tm\n- auto\\_exception\\_rule \\(reference=sn\\_sec\\_exception\\_rule\\)\n- change\\_approval \\(reference=sn\\_sec\\_exception\\_change\\_approval\\)\n- ignore\\_expiration\\_for\\_risk\\_reduction\\_dt\\_tm\n- ignore\\_expiration\\_dt\\_tm\n\nApplication Vulnerable Item \\[sn\\_vul\\_app\\_vulnerable\\_item\\] table.\n\n- remediation\\_commitment\\_dt\\_tm\n- status\n- age\\_duration\n- source\\_risk\\_score\n- times\\_found\n- first\\_found\\_dt\\_tm\n- resolution\\_dt\\_tm\n- last\\_opened\\_dt\\_tm\n- auto\\_exception\\_rule \\(reference=sn\\_sec\\_exception\\_rule\\)\n- change\\_approval \\(reference=sn\\_sec\\_exception\\_change\\_approval\\)\n- ignore\\_expiration\\_for\\_risk\\_reduction\\_dt\\_tm\n- ignore\\_expiration\\_dt\\_tm\n\nTest Result \\[sn\\_vulc\\_result\\] table.\n\n- closed\\_by\n- first\\_found\\_dt\\_tm\n- last\\_found\\_dt\\_tm\n- opened\\_at\n- opened\\_by\n- resolution\\_dt\\_tm\n- last\\_state\\_changed\\_on\n- sys\\_class\\_name\n- integration\n- backup\\_state\n- backup\\_substate\n- business\\_criticality\n- short\\_description\n- status\n- source\\_risk\\_score\n- times\\_found\n- close\\_notes\n- substate\n- state\\_inheritance\\_count\n- priority\n- reopened\n- remediation\\_plan\n- remediation\\_commitment\\_dt\\_tm\n- auto\\_exception\\_rule \\(reference=sn\\_sec\\_exception\\_rule\\)\n- change\\_approval \\(reference=sn\\_sec\\_exception\\_change\\_approval\\)\n- ignore\\_expiration\\_for\\_risk\\_reduction\\_dt\\_tm\n- ignore\\_expiration\\_dt\\_tm\n\nContainer Vulnerable Item \\[sn\\_vul\\_container\\_image\\_vulnerable\\_item\\] table.\n\n- remediation\\_plan\n- remediation\\_commitment\\_dt\\_tm\n- auto\\_exception\\_rule \\(reference=sn\\_sec\\_exception\\_rule\\)\n- change\\_approval \\(reference=sn\\_sec\\_exception\\_change\\_approval\\)\n- ignore\\_expiration\\_for\\_risk\\_reduction\\_dt\\_tm\n- ignore\\_expiration\\_dt\\_tm\n\nRemediation task \\[sn\\_vul\\_vulnerability\\] table.\n\n- remediation\\_commitment\\_dt\\_tm\n- remediation\\_plan\n- change\\_approval \\(reference=sn\\_sec\\_exception\\_change\\_approval\\)\n- ignore\\_expiration\\_for\\_risk\\_reduction\\_dt\\_tm\n- ignore\\_expiration\\_dt\\_tm\n\nApplication Remediation Task \\[sn\\_vul\\_app\\_vulnerability\\] table.\n\n- remediation\\_commitment\\_dt\\_tm\n- change\\_approval \\(reference=sn\\_sec\\_exception\\_change\\_approval\\)\n- ignore\\_expiration\\_for\\_risk\\_reduction\\_dt\\_tm\n- ignore\\_expiration\\_dt\\_tm\n\nRemediation task \\[sn\\_vulc\\_result\\_group\\] table.\n\n- remediation\\_commitment\\_dt\\_tm\n- remediation\\_plan\n- change\\_approval \\(reference=sn\\_sec\\_exception\\_change\\_approval\\)\n- ignore\\_expiration\\_for\\_risk\\_reduction\\_dt\\_tm\n- ignore\\_expiration\\_dt\\_tm\n\nContainer Remediation Task \\[sn\\_vul\\_container\\_vulnerability\\] table.\n\n- remediation\\_commitment\\_dt\\_tm\n- remediation\\_plan\n- change\\_approval \\(reference=sn\\_sec\\_exception\\_change\\_approval\\)\n- ignore\\_expiration\\_for\\_risk\\_reduction\\_dt\\_tm\n- ignore\\_expiration\\_dt\\_tm\n\n**Parent Topic:**[Unified Security Exposure Management reference](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/security-management/unified-security-exposure-management-reference.md)\n\n"}}