Learn Database Administration (CSA) with Interactive Flashcards
Master key concepts in Database Administration through our interactive flashcard system. Click on each card to reveal detailed explanations and enhance your understanding.
Data Schema Model
A Data Schema Model in ServiceNow represents the structural blueprint that defines how data is organized, stored, and related within the platform's database. Understanding this concept is essential for both System Administrators and Database Administrators working with ServiceNow.
At its core, ServiceNow uses a relational database structure where data is stored in tables. Each table consists of fields (columns) that define the attributes of records (rows). The schema model encompasses all these tables, their fields, and the relationships between them.
Key components of the ServiceNow Data Schema Model include:
**Tables**: These are the primary containers for data. ServiceNow includes base system tables like Incident, Problem, Change Request, and User tables. Administrators can also create custom tables to meet specific business requirements.
**Fields**: Each table contains multiple fields with defined data types such as string, integer, date/time, reference, and choice fields. Field attributes include length, mandatory status, and default values.
**Relationships**: Tables connect through reference fields, creating parent-child relationships. For example, an Incident record references a User record for the caller field. These relationships enable data integrity and efficient querying.
**Inheritance**: ServiceNow employs table extension, where child tables inherit fields and business logic from parent tables. The Task table serves as a base table extended by Incident, Problem, and Change tables.
**Indexes**: These optimize query performance by creating efficient lookup paths for frequently accessed data.
**Dictionary**: The system dictionary stores metadata about all tables and fields, serving as the central repository for schema information.
Administrators access the schema through the Table and Column modules, Schema Map, and Dictionary. Understanding the data schema model enables effective customization, reporting, integration development, and performance optimization. Proper schema design ensures data consistency, reduces redundancy, and supports scalable application development within the ServiceNow platform.
Tables and Table Administration
Tables are the fundamental building blocks of the ServiceNow platform, serving as the primary data storage mechanism similar to tables in traditional relational databases. Each table consists of rows (records) and columns (fields) that store specific types of information. In ServiceNow, tables are used to organize and manage data for various applications, including incidents, problems, changes, and custom business processes.
Table Administration involves managing the structure, properties, and relationships of tables within the ServiceNow instance. System Administrators access table administration through the System Definition module, where they can create new tables, modify existing ones, and configure table properties.
Key aspects of Table Administration include:
1. **Table Creation**: Administrators can create custom tables to store application-specific data. Tables can extend existing tables, inheriting fields and functionality from parent tables.
2. **Field Management**: Adding, modifying, or removing columns (fields) from tables. Fields have various types including string, integer, reference, date/time, and choice lists.
3. **Table Properties**: Configuration options include setting the table label, plural label, access controls, and whether the table is extensible or audited.
4. **Table Relationships**: Tables can reference other tables through reference fields, creating relationships between different data sets. This enables linked records and data integrity.
5. **Schema Maps**: Visual representations of table relationships help administrators understand the data model and plan modifications.
6. **Table Rotation and Archiving**: For performance optimization, administrators can configure table rotation policies to manage large datasets and historical data.
7. **Dictionary Entries**: Each field in a table has a dictionary entry that defines its attributes, including maximum length, default values, and display characteristics.
Proper table administration ensures data integrity, optimal performance, and a well-organized database structure that supports business requirements effectively.
Fields and Field Types
Fields are the fundamental building blocks of tables in ServiceNow, representing individual columns that store specific pieces of data. Each field has a defined field type that determines what kind of data it can hold and how that data is displayed and validated.
ServiceNow offers numerous field types to accommodate various data requirements:
**String Fields**: Store text data with configurable maximum lengths. Examples include single-line text fields and multi-line text areas for longer content like descriptions or notes.
**Numeric Fields**: Include Integer fields for whole numbers, Decimal fields for numbers with decimal points, and Currency fields for monetary values with associated currency codes.
**Reference Fields**: Create relationships between tables by storing sys_id values that point to records in other tables. These enable powerful relational database functionality and allow users to select from existing records.
**Date and Time Fields**: Store temporal information including Date fields, Date/Time fields for timestamps, and Duration fields for time spans. These support various display formats and time zone handling.
**Choice Fields**: Allow users to select from predefined options. These can be configured as dropdowns with single or multiple selection capabilities.
**Boolean Fields**: Store true/false values, typically displayed as checkboxes in forms.
**Journal Fields**: Special fields like Work Notes and Additional Comments that maintain a historical log of entries with timestamps and user attribution.
**Other Field Types**: Include URL fields for web addresses, Email fields with validation, HTML fields for formatted content, and Attachment fields for file storage.
Administrators configure fields through the Dictionary, where they define attributes like mandatory requirements, default values, read-only status, and display characteristics. Understanding field types is essential for proper database design, ensuring data integrity, and creating effective user interfaces that capture information accurately and efficiently within the ServiceNow platform.
Field Attributes
Field Attributes in ServiceNow are properties that define the behavior, appearance, and functionality of fields within tables and forms. As a System Administrator, understanding field attributes is essential for proper database administration and form customization.
Field attributes control various aspects of how data is stored, displayed, and validated. Key attributes include:
**Type**: Defines the data type such as String, Integer, Reference, Date/Time, Boolean, or Choice. This determines what kind of data the field can store and how it appears on forms.
**Max Length**: Specifies the maximum number of characters allowed for string fields, helping maintain data consistency and database efficiency.
**Mandatory**: When set to true, users must populate this field before saving a record. This ensures critical data is captured.
**Read Only**: Prevents users from modifying the field value through the form interface, protecting important data from accidental changes.
**Default Value**: Automatically populates the field with a predetermined value when creating new records, improving data entry efficiency.
**Reference**: For reference fields, this attribute specifies which table the field links to, establishing relationships between tables.
**Display**: Marks a field as the display value shown when the record is referenced elsewhere in the system.
**Unique**: Ensures no duplicate values exist in that field across all records in the table.
**Active**: Determines whether the field is currently in use within the system.
**Attributes**: A special property containing additional configurations like edge_encryption, no_sort, or ref_auto_completer that modify field behavior.
Administrators manage field attributes through the Dictionary (sys_dictionary) table or by navigating to System Definition > Dictionary. Changes to field attributes can impact existing data, business rules, and integrations, so modifications should be tested thoroughly in sub-production environments before deployment to production systems.
Dictionary Entries
Dictionary Entries in ServiceNow are fundamental components that define the structure and properties of every field within the platform's database tables. As a System Administrator, understanding Dictionary Entries is essential for effective database management and customization.
Each Dictionary Entry represents a single field definition and contains critical metadata that controls how data is stored, displayed, and validated. When you create or modify a table field, you are essentially working with its corresponding Dictionary Entry.
Key attributes stored in Dictionary Entries include:
1. **Column Name**: The internal database name used for the field.
2. **Column Label**: The user-friendly display name shown on forms and lists.
3. **Type**: Defines the data type such as String, Integer, Reference, Date/Time, Choice, or Boolean.
4. **Max Length**: Specifies the maximum character limit for text fields.
5. **Default Value**: Sets an automatic value when new records are created.
6. **Reference**: For reference fields, identifies which table the field points to.
7. **Mandatory**: Determines whether the field requires a value before saving.
8. **Read Only**: Controls whether users can edit the field.
9. **Active**: Enables or disables the field.
Administrators access Dictionary Entries through System Definition > Dictionary or by right-clicking on any field and selecting Configure Dictionary. This allows for granular control over field behavior across the platform.
Dictionary Entries also support advanced configurations including calculated values, dependent fields, and field-level security through Access Control Lists. Changes to Dictionary Entries affect all forms, lists, and reports that display the associated field.
Best practices include documenting custom Dictionary Entries, using meaningful naming conventions, and testing changes in non-production environments first. Understanding Dictionary Entries empowers administrators to tailor ServiceNow tables to meet specific organizational requirements while maintaining data integrity throughout the system.
Table Relationships
Table Relationships in ServiceNow are fundamental concepts that define how different tables connect and interact with each other within the platform's relational database structure. Understanding these relationships is essential for effective database administration and system configuration.
There are several types of table relationships in ServiceNow:
1. **One-to-Many Relationships**: This is the most common relationship type where one record in a parent table can be associated with multiple records in a child table. For example, one Incident can have many Work Notes attached to it. This is typically implemented using reference fields.
2. **Many-to-Many Relationships**: These occur when multiple records in one table can relate to multiple records in another table. ServiceNow handles this through M2M (Many-to-Many) tables that serve as intermediary junction tables storing the associations between records.
3. **One-to-One Relationships**: A single record in one table corresponds to exactly one record in another table. This is less common but useful for extending table functionality.
4. **Table Extension (Inheritance)**: ServiceNow uses table extension where child tables inherit fields and configurations from parent tables. For instance, the Incident table extends the Task table, inheriting all Task fields while adding incident-specific attributes.
**Reference Fields** are the primary mechanism for creating relationships. They store the sys_id of related records and enable navigation between connected data.
**Glide Lists** allow storing multiple reference values in a single field, creating lightweight many-to-many relationships.
Proper relationship design ensures data integrity, enables efficient querying through dot-walking notation, and supports business logic across related records. Administrators must understand these relationships to create accurate reports, configure business rules, and maintain database performance.
Relationships also impact Access Control Lists (ACLs) and cascading operations like deletes, making their proper configuration critical for security and data management.
Reference Fields
Reference Fields in ServiceNow are a fundamental concept that every Certified System Administrator must understand thoroughly. A Reference Field is a special field type that creates a relationship between two tables by storing a reference to a record in another table. Instead of storing actual data values, Reference Fields store the sys_id (unique identifier) of a record from the referenced table.
When you create a Reference Field, you establish a many-to-one relationship between tables. For example, the Incident table has a Reference Field called 'Assigned to' that points to the User (sys_user) table. This allows each incident to be linked to a specific user record.
Key characteristics of Reference Fields include:
1. **Display Value vs. Actual Value**: The field displays a human-readable value (like a user's name) but stores the sys_id behind the scenes. This separation ensures data integrity even if the display value changes.
2. **Dot-Walking**: Reference Fields enable dot-walking, a powerful feature allowing you to access fields from the referenced table. For instance, incident.assigned_to.email retrieves the email address from the linked user record.
3. **Reference Qualifiers**: Administrators can restrict which records appear in the reference lookup using reference qualifiers, filtering options based on specific conditions.
4. **Auto-Complete**: Users benefit from auto-complete functionality when populating Reference Fields, making data entry efficient and accurate.
5. **Referential Integrity**: ServiceNow maintains relationships between records, though administrators must configure deletion rules to handle orphaned references appropriately.
From a database perspective, Reference Fields are stored as 32-character GUID strings (sys_id values). Understanding this storage mechanism is essential when writing queries, creating reports, or performing data migrations. Reference Fields form the backbone of ServiceNow's relational data model, enabling complex workflows, reporting relationships, and seamless navigation between related records throughout the platform.
Glide Lists
Glide Lists are a fundamental component in ServiceNow that allow administrators to store and manage multiple values within a single database field. Unlike traditional relational database fields that hold only one value, Glide Lists enable the storage of comma-separated values, making them ideal for scenarios where multiple selections are required.
In ServiceNow, Glide Lists are commonly used for fields like 'Watch list' on incident records, where multiple users need to be notified about updates. The field type 'List' in the dictionary stores these values as a string of sys_ids separated by commas, while the platform handles the display and manipulation through the user interface.
From a database administration perspective, Glide Lists utilize a many-to-many relationship concept but store it differently than traditional junction tables. The values are serialized into a single field, which can impact query performance when searching within these fields. Administrators should be mindful of this when designing solutions that require frequent filtering based on list contents.
The GlideList2 API provides client-side JavaScript methods for manipulating list fields, allowing developers to add, remove, or retrieve values programmatically. Server-side manipulation is handled through GlideRecord methods where you can use setValue() and getValue() to manage the comma-separated string.
Key considerations for System Administrators include understanding that Glide Lists have size limitations based on the underlying field length, and that reporting on list fields can be challenging since standard queries may not efficiently search within the concatenated values. Best practices suggest using Glide Lists for relatively small collections of related records.
When configuring list fields, administrators can specify the reference table that defines what type of records can be added to the list. This ensures data integrity by restricting selections to valid records from the designated table, such as limiting a user list field to only accept records from the sys_user table.
Configuration Management Database (CMDB)
A Configuration Management Database (CMDB) is a centralized repository that stores information about all the significant entities in your IT environment, known as Configuration Items (CIs). In ServiceNow, the CMDB serves as the foundation for IT Service Management (ITSM) processes by providing a single source of truth for your infrastructure data.
Configuration Items represent any component that needs to be managed to deliver IT services. These include hardware assets like servers, workstations, and network devices, as well as software applications, databases, virtual machines, cloud resources, and even business services. Each CI contains attributes that describe its properties, such as name, serial number, location, owner, and operational status.
One of the most powerful features of the CMDB is its ability to store and display relationships between CIs. These relationships show how different components depend on or connect to each other. For example, a business application might run on a specific server, which connects to a particular database and relies on certain network equipment. Understanding these relationships helps administrators assess the impact of changes or outages.
The CMDB integrates with various ServiceNow modules including Incident Management, Problem Management, Change Management, and Asset Management. When an incident occurs, technicians can quickly identify affected CIs and understand potential downstream impacts. During change planning, administrators can evaluate which services might be affected by modifications to specific infrastructure components.
Maintaining CMDB accuracy requires regular updates through Discovery tools, which automatically scan your environment to identify and update CI information. Integration with other data sources and manual updates also help keep the database current.
Effective CMDB management follows best practices including establishing data governance policies, defining clear CI classifications, implementing regular audits, and ensuring proper access controls. A well-maintained CMDB reduces incident resolution time, improves change success rates, and supports informed decision-making across IT operations.
Configuration Items (CIs)
Configuration Items (CIs) are fundamental components within ServiceNow's Configuration Management Database (CMDB). A CI represents any resource, component, or service that needs to be managed to deliver IT services successfully. These items can include hardware such as servers, laptops, routers, and switches, as well as software applications, databases, documentation, and even business services.
In ServiceNow, CIs are stored in the CMDB, which serves as a centralized repository containing detailed information about each item and its relationships with other components. This structured approach enables organizations to maintain visibility into their IT infrastructure and understand dependencies between various elements.
Each CI record contains essential attributes including a unique identifier, name, classification, status, owner, location, and associated relationships. The CI Class defines the type of configuration item, such as cmdb_ci_server for servers or cmdb_ci_computer for computers. These classes inherit properties from parent classes, creating a hierarchical structure that promotes consistency and standardization.
Relationships between CIs are crucial for understanding how changes to one component might affect others. ServiceNow tracks these connections through relationship types like 'Depends on', 'Used by', 'Contains', and 'Hosted on'. This relationship mapping proves invaluable during incident management, change management, and impact analysis.
From a database administration perspective, CIs are stored across multiple tables extending from the base cmdb_ci table. Administrators must understand table inheritance, indexing strategies, and data integrity considerations when managing CI data. Regular maintenance tasks include data validation, duplicate detection, and ensuring relationship accuracy.
Effective CI management supports various ITSM processes including Incident Management (identifying affected services), Change Management (assessing change impacts), Problem Management (root cause analysis), and Asset Management (lifecycle tracking). Organizations benefit from improved decision-making, reduced downtime, and enhanced service delivery through proper CI administration.
CI Relationships
CI Relationships in ServiceNow refer to the connections and dependencies between Configuration Items (CIs) stored in the Configuration Management Database (CMDB). These relationships are essential for understanding how different IT assets interact, depend on each other, and impact service delivery within an organization.
A Configuration Item represents any component that needs to be managed to deliver IT services, such as servers, applications, network devices, databases, and software. CI Relationships define how these items connect, creating a comprehensive map of your IT infrastructure.
There are several types of CI Relationships in ServiceNow:
1. **Parent-Child Relationships**: These establish hierarchical connections where one CI contains or owns another. For example, a server (parent) may host multiple virtual machines (children).
2. **Dependency Relationships**: These show which CIs rely on others to function properly. An application might depend on a specific database server to operate.
3. **Connection Relationships**: These indicate physical or logical connections between CIs, such as network cables connecting switches to routers.
4. **Membership Relationships**: These group CIs together, like servers belonging to a cluster.
The cmdb_rel_ci table stores all relationship records in ServiceNow. Each relationship record contains a parent CI, child CI, and relationship type that describes the nature of the connection.
Understanding CI Relationships provides several benefits for system administrators. During incident management, you can quickly identify affected services when a CI fails. Change management becomes more effective because you can assess the potential impact of modifications. Problem management benefits from tracing root causes through relationship chains.
The Dependency Views feature in ServiceNow provides visual representations of CI relationships, allowing administrators to see upstream and downstream dependencies. This graphical interface helps in impact analysis and service mapping.
Maintaining accurate CI relationships requires regular audits and updates through discovery tools or manual processes to ensure the CMDB reflects the current state of your infrastructure.
Common Service Data Model (CSDM)
The Common Service Data Model (CSDM) is a standardized framework developed by ServiceNow that provides a consistent approach to organizing and structuring data within the ServiceNow platform. It serves as a foundational blueprint for how organizations should model their IT services, applications, and infrastructure components in the Configuration Management Database (CMDB).
CSDM establishes a unified taxonomy and set of best practices that help organizations maintain data integrity and consistency across their ServiceNow implementation. The model defines key domains including Foundation Data, Design Data, Build/Change Data, Manage Data, and Sell/Consume Data. Each domain contains specific Configuration Item (CI) classes and their relationships.
At its core, CSDM helps organizations answer fundamental questions about their IT environment: What business services do we offer? What applications support those services? What infrastructure components run those applications? This hierarchical approach creates clear visibility from business capabilities down to technical components.
Key components of CSDM include Business Services, which represent customer-facing offerings; Technical Services, which are the IT capabilities supporting business services; Application Services, representing running applications; and various infrastructure CIs like servers, databases, and network devices.
For System Administrators and Database Administrators, understanding CSDM is crucial because it guides how data should be populated, maintained, and related within the CMDB. Proper implementation ensures accurate service mapping, improved incident management, better change impact analysis, and more effective asset management.
CSDM also supports ITIL processes by providing the data structure needed for effective service management. Organizations adopting CSDM benefit from reduced complexity, improved reporting accuracy, and better alignment between IT operations and business objectives. ServiceNow regularly updates CSDM guidelines, making it essential for administrators to stay current with the latest version and recommendations for optimal platform utilization.
Application and Module Configuration
Application and Module Configuration in ServiceNow is a fundamental aspect of customizing the platform to meet organizational needs. Applications in ServiceNow represent logical groupings of related functionality, appearing as menu items in the Application Navigator (left sidebar). Each application contains modules, which are individual menu options that provide access to specific features, lists, records, or pages.
To configure applications, administrators navigate to System Definition > Applications. Here, you can create new applications, modify existing ones, set display order, assign roles for access control, and determine visibility settings. Applications can be categorized and organized to streamline user navigation based on departmental or functional requirements.
Modules are configured through System Definition > Modules. Each module belongs to a parent application and can be configured with several key properties: Title (display name), Application (parent application), Order (position within the application), Roles (access permissions), and Link Type (determines what the module displays). Common link types include List of Records, URL, Content Page, Script, and Separator.
The Link Type configuration is crucial as it defines module behavior. A List of Records type displays filtered table data, while URL types can link to external sites or internal pages. Script-based modules execute server-side code to determine dynamic content or redirects.
Role-based access control ensures modules appear only to authorized users. By assigning specific roles to modules, administrators can create tailored navigation experiences for different user groups such as IT staff, managers, or end users.
Application menus can also be customized using Application Menus (sys_app_application table) to create hierarchical navigation structures. Administrators can duplicate existing applications, create application templates, and use update sets to migrate configurations between instances.
Effective application and module configuration improves user experience, reduces clutter, and ensures users can efficiently access the tools and information relevant to their responsibilities within the ServiceNow platform.
Access Control Rules
Access Control Rules (ACLs) in ServiceNow are security mechanisms that control what data users can access and what operations they can perform on that data. They serve as gatekeepers protecting tables, fields, and records within the platform.
ACLs operate on three main levels: Table level (controlling access to entire tables), Field level (restricting access to specific columns), and Record level (determining which rows users can view or modify). Each rule evaluates conditions to grant or deny permissions for read, write, create, and delete operations.
The structure of an ACL consists of several components. First, the Object being protected, which could be a table, field, or record. Second, the Operation type such as read, write, create, or delete. Third, the Conditions that must be met, which can include role requirements, scripts, or field conditions.
ServiceNow evaluates ACLs using a specific order of precedence. More specific rules take priority over general ones. For example, a field-level ACL takes precedence over a table-level ACL. When multiple rules apply, all conditions must pass for access to be granted.
Roles play a crucial part in ACL configuration. Administrators can require users to have specific roles before accessing protected resources. The admin role typically bypasses most ACL restrictions, which is why it should be assigned carefully.
Best practices for ACL management include testing rules thoroughly before deployment, using the Security Admin role to manage ACLs, documenting all custom rules, and following the principle of least privilege by granting minimum necessary access.
The ACL debugging tool helps administrators troubleshoot access issues by showing which rules are being evaluated and their results. This is essential for identifying why users might be experiencing permission problems.
Proper ACL configuration ensures data security, maintains compliance requirements, and provides users with appropriate access levels based on their organizational responsibilities within the ServiceNow platform.
Before and After Business Rules
Before and After Business Rules are server-side scripts in ServiceNow that execute when database operations occur on tables. They are fundamental components for automating processes and enforcing business logic within the platform.
Before Business Rules execute prior to a database operation being committed. They run when a record is inserted, updated, deleted, or queried. These rules are ideal for data validation, field manipulation, and setting default values. Since they execute ahead of the database commit, any changes made to the current object will be saved along with the original transaction. For example, you might use a Before Business Rule to automatically populate a field based on other field values, validate that required conditions are met, or modify data prior to it being stored. If validation fails, you can use current.setAbortAction(true) to prevent the record from being saved.
After Business Rules execute following the successful completion of a database operation. At this point, the record has already been committed to the database. These rules are perfect for triggering related actions, creating associated records, sending notifications, or updating other tables based on the newly saved data. For instance, after an incident is created, you might want to generate related tasks or send email notifications to stakeholders.
Key differences include timing and use cases. Before rules allow modification of the current record being processed, while After rules work with data that is already persisted. After rules should be used when you need to reference the sys_id of a newly created record or when performing operations that depend on the committed state.
Best practices include keeping business rules efficient to avoid performance issues, using conditions to limit when rules execute, and documenting the purpose of each rule. Understanding when to use Before versus After rules is essential for ServiceNow administrators to implement effective automation and maintain data integrity across the platform.
Import Sets
Import Sets in ServiceNow are powerful staging tables that serve as temporary holding areas for data being imported into the platform from external sources. They act as an intermediary layer between external data and the target ServiceNow tables, enabling administrators to transform, validate, and map data before it becomes permanent records in the system.
When data is imported into ServiceNow through various methods such as Excel files, CSV files, JDBC connections, or web services, it first lands in an Import Set table. This staging approach provides several critical advantages for database administration.
The Import Set process involves three main components: the Data Source, which defines where the data originates; the Import Set Table, which stores the raw imported data temporarily; and Transform Maps, which define how source fields map to target table fields.
Transform Maps are essential as they allow administrators to define field mappings, create coalesce fields for matching existing records, apply scripts for data manipulation, and set conditions for when transformations should occur. This ensures data integrity and prevents duplicate records from being created.
During the transformation process, administrators can run scripts to modify data, validate entries, and handle exceptions. The system tracks the status of each imported row, marking records as inserted, updated, ignored, or error based on the transformation results.
Import Set tables retain historical data by default, allowing administrators to review past imports and troubleshoot issues. However, these tables should be cleaned periodically to maintain system performance, which can be automated through scheduled jobs.
For System Administrators, understanding Import Sets is crucial for data migration projects, integrations with external systems, and bulk data updates. They provide a safe, auditable method for bringing external data into ServiceNow while maintaining data quality and system stability through the validation and transformation capabilities built into the platform.
Data Sources
Data Sources in ServiceNow are configuration records that define how external data is imported into the ServiceNow platform. They serve as the foundation for data import operations, specifying the location, format, and connection details needed to retrieve information from external systems. Data Sources work in conjunction with Import Sets and Transform Maps to bring data into ServiceNow tables.
Key components of a Data Source include:
1. **Type**: Defines the source format such as File, JDBC, LDAP, REST, or custom scripts. Each type requires specific configuration parameters appropriate to that connection method.
2. **Connection Information**: Contains credentials, URLs, file paths, or database connection strings necessary to access the external data repository.
3. **Data Format**: Specifies whether the incoming data is CSV, XML, JSON, Excel, or another supported format for file-based sources.
4. **Import Set Table**: References the staging table where raw data lands before transformation into target tables.
5. **Properties**: Additional settings that control behavior like header rows, sheet names for Excel files, or query parameters for database connections.
The import process flows as follows: Data Source retrieves external data, which populates an Import Set staging table. Transform Maps then process this staged data, mapping source fields to destination fields in production tables while applying any necessary data transformations or coalescing logic.
Administrators can schedule Data Sources to run automatically using scheduled imports, enabling regular synchronization with external systems. This is particularly valuable for maintaining user records from HR systems, asset information from external databases, or configuration data from other enterprise tools.
Data Sources support test loads, allowing administrators to validate configurations before executing full imports. This preview capability helps identify potential issues with field mappings or data quality before affecting production data. Proper Data Source configuration ensures reliable, repeatable data integration workflows within ServiceNow environments.
Transform Maps
Transform Maps in ServiceNow are powerful tools that define how data from an import set table is mapped and transferred into a target table within the ServiceNow database. They serve as the bridge between imported external data and the production tables where that data needs to reside.
When you import data into ServiceNow through various methods such as CSV files, JDBC connections, or web services, the data first lands in a staging area called an import set table. Transform Maps then take this raw imported data and apply rules to convert, validate, and insert it into the appropriate destination tables.
Key components of Transform Maps include:
1. Source Table: The import set table containing the incoming data that needs to be processed.
2. Target Table: The production table where the transformed data will be stored, such as the Incident, User, or Configuration Item tables.
3. Field Maps: These define the relationship between source columns and target fields. You can map fields one-to-one or use scripts to manipulate data during the mapping process.
4. Coalesce Fields: These fields help identify existing records in the target table to determine whether to update an existing record or create a new one. This prevents duplicate entries.
5. Transform Scripts: onStart, onBefore, onAfter, and onComplete scripts allow administrators to execute custom logic at different stages of the transformation process.
6. Run Business Rules: You can configure whether standard business rules should execute during the transform operation.
Transform Maps support both automatic mapping based on matching field names and manual mapping for more complex scenarios. They also provide error handling capabilities and logging to track successful transformations and identify issues.
Administrators frequently use Transform Maps for bulk data migrations, regular data synchronization with external systems, and initial system setup when populating ServiceNow instances with organizational data from legacy systems.
Field Maps and Coalesce
Field Maps and Coalesce are essential concepts in ServiceNow data management, particularly when working with Import Sets and Transform Maps.
Field Maps define the relationship between source data columns and target table fields during data imports. When you import data into ServiceNow using Import Sets, the system first loads the data into a staging table. Transform Maps then use Field Maps to specify how each source column should map to the corresponding destination field in the target table. You can create automatic field mappings based on matching column names, or manually define custom mappings for more complex scenarios. Field Maps also support scripting, allowing you to manipulate data during the transformation process through onBefore and onAfter scripts.
Coalesce is a powerful feature that determines how imported records interact with existing records in the target table. When coalesce is enabled on a field mapping, ServiceNow uses that field as a unique identifier to find matching records. If a match is found, the system updates the existing record rather than creating a duplicate. If no match exists, a new record is created. You can set coalesce on multiple fields simultaneously, requiring all coalesced fields to match for an update to occur.
For example, if you are importing user data and set coalesce on the email field, ServiceNow will search for existing users with matching email addresses. Matching records get updated with the new import data, while unique email addresses result in new user records.
Best practices include carefully selecting coalesce fields that truly represent unique identifiers, testing transforms in non-production environments first, and using the Transform Map preview feature to verify mappings before processing large data sets. Understanding these concepts ensures clean data migrations and prevents duplicate records in your ServiceNow instance.
Scheduled Data Imports
Scheduled Data Imports in ServiceNow provide a powerful mechanism for automatically importing data from external sources into the ServiceNow platform on a recurring basis. This feature is essential for maintaining synchronized data between ServiceNow and other enterprise systems.
A Scheduled Data Import combines two key components: a Data Source and a Transform Map. The Data Source defines where the data originates from, which can include JDBC connections to external databases, file attachments (CSV, Excel, XML), FTP locations, or HTTP connections. The Transform Map specifies how incoming data fields map to ServiceNow table fields and includes any transformation scripts needed during the import process.
To create a Scheduled Data Import, administrators navigate to System Import Sets > Scheduled Imports > Scheduled Import. Here, you configure the data source connection details, select or create appropriate transform maps, and establish the schedule frequency. Schedules can be set to run at specific intervals such as daily, weekly, or custom timeframes using cron expressions.
Key configuration options include setting the import order when multiple imports exist, enabling or disabling the scheduled job, and configuring email notifications for import completion or failures. Administrators can also define concurrent import limits to manage system resources effectively.
The import process creates Import Set records that serve as staging tables, allowing data validation before committing to target tables. Transform maps can include scripts for data manipulation, coalescing rules for matching existing records, and choice actions for handling field mappings.
Best practices include testing imports manually before scheduling, implementing proper error handling, monitoring import logs regularly, and using appropriate coalesce fields to prevent duplicate records. Administrators should also consider system load and schedule imports during off-peak hours when possible.
Scheduled Data Imports are crucial for maintaining data integrity and reducing manual data entry efforts, making them an indispensable tool for ServiceNow administrators managing enterprise data integration requirements.
Data Export
Data Export in ServiceNow is a fundamental capability that allows administrators to extract data from the platform for various purposes including reporting, backup, analysis, and integration with external systems. As a Certified System Administrator, understanding data export functionality is essential for effective database administration.
ServiceNow provides multiple methods for exporting data. The most common approach is through list views, where users can select records and export them in formats such as CSV, Excel, XML, JSON, or PDF. This method is accessible from any list by right-clicking or using the context menu options.
For more advanced export needs, administrators can utilize the Export Sets feature, which allows scheduling automated exports of specific tables or filtered data sets. These scheduled exports can be configured to run at predetermined intervals and can be delivered to external locations via FTP, email, or other attachment methods.
The platform also supports data export through Integration Hub, REST APIs, and SOAP web services for programmatic data extraction. These methods are particularly useful when building integrations with third-party systems or creating custom reporting solutions.
Security considerations are paramount when exporting data. Administrators must ensure that Access Control Lists (ACLs) are properly configured to restrict export capabilities to authorized users only. Sensitive data should be protected through field-level security and data masking where appropriate.
Best practices for data export include limiting the number of records exported at once to prevent performance issues, using appropriate filters to extract only necessary data, and maintaining audit trails of export activities for compliance purposes.
Administrators should also be aware of system properties that control export behavior, such as maximum row limits and timeout settings. Understanding these configurations helps optimize export operations while maintaining system performance and stability across the ServiceNow instance.