Import XLSX CSV Data Files Into SQL Server ASP.NETImport XLSX CSV Data Files Into SQL Server ASP.NET
Import data files in various formats such as xlsx and csv into SQL Server using the power & simplicity of ASP.NET CoreImport XLSX CSV Data Files Into SQL Server ASP.NET
Import data files in various formats such as xlsx and csv into SQL Server using the power & s...Overview
Introduction:
The project aims to develop a robust and efficient web application using ASP.NET Core 8 technologies that allows user to import data files, such as XLSX and CSV into a SQL Server database. This application will provide a seamless and user-friendly experience for importing large volumes of data from various file formats (XLSX, CSV) using ASP.NET Core Web API, XML Bulk Insert, Dapper, CsvHelper, EPPlus and coding best practices.
Key Features:
» XLSX and CSV File Support: The application supports importing data from both XLSX and CSV file formats.
» File Validation and Error Handling: Before data import, files are validated for format and structure. Detailed error handling provides informative messages to users.
» Mapping and Transformation: Data mapping and transformation allow users to map columns from files to database fields and perform necessary transformations during import.
» Data Import Performance Optimization: The application optimizes data import performance using XML Bulk Insert and Dapper to efficiently insert large volumes of data into the SQL Server database.
Tools and Technology Used:
» C#
» ASP.NET Core 8 Web API
» ASP.NET Core 8 Razor Pages
» Clean Architecture
» Dapper as ORM
» XML Bulk Insert
» CsvHelper
» EPPlus
» Bootstrap
Live Preview:
http://108.181.173.241/Demo/ImportDataFile/User/
(Sample Excel File, Sample CSV File)
Screenshot:
Quick Start Guide:
To get started with the solution, follow these steps:
» Make sure you have the required tools and technologies installed.
» The solution has two separate execuable projects; ImportDataFile.API and ImportDataFile.UI. Make sure to run API project first, then the UI project.
» Make sure to change the settings in appsettings files according to your UserRootPath, ConnectionStrings, BaseAPIAddress, SiteSettings etc.
» Start exploring the features and functionalities of the solution. You can go through the detailed documentation for more details at: Detailed Documentation
What You Will Get:
» Full Source Code with Visual Studio Solution
» Database Script in SQL Express 2019
Support Facility:
Have any questions, issues, or doubts? Feel free to reach out via the comments section or email for direct consultations: [email protected]
Features
» XLSX and CSV File Support: The application supports importing data from both XLSX and CSV file formats.
» File Validation and Error Handling: Before data import, files are validated for format and structure. Detailed error handling provides informative messages to users.
» Mapping and Transformation: Data mapping and transformation allow users to map columns from files to database fields and perform necessary transformations during import.
» Data Import Performance Optimization: The application optimizes data import performance using XML Bulk Insert and Dapper to efficiently insert large volumes of data into the SQL Server database.
Requirements
To use the solution, you will need the following:
» ASP.NET Core 8
» SQL Server Express 2019
» Visual Studio 2022
Instructions
To get started with the solution, follow these steps:
» Make sure you have the required tools and technologies installed.
» The solution has two separate execuable projects; ImportDataFile.API and ImportDataFile.UI. Make sure to run API project first, then the UI project.
» Make sure to change the settings in appsettings files according to your UserRootPath, ConnectionStrings, BaseAPIAddress, SiteSettings etc.
» Start exploring the features and functionalities of the solution.
Other items by this author
Category | Scripts & Code / C# |
First release | 13 September 2023 |
Last update | 11 April 2024 |
HTML/CSS Framework | Bootstrap |
Files included | .aspx, .css, .sql, .cs, .csproj |
JavaScript Framework | jQuery |
Tags | SQL Server, asp.net core, dapper, web api, razor pages, c-sharp, csvhelper, epplus, import csv, import excel, xml bulk insert |