BI Tracks
BI Tracks
  • 83
  • 77 613
ELT or ETL Data Integration in Azure Data Studio Notebooks
Learn more about notebookSnap today - www.bitracks.com/notebooksnap
notebookSnap on GitHub - github.com/Jim-BITracks/notebook_snap_install
Install Instructional Video - czcams.com/video/Kdq9m-5ouBg/video.html
There is a new product set to modernize the data integration industry by the name of notebookSnap, which is fully driven by Azure Data Studio. The process it uses to create ELT or ETL projects can be compared to the process of making a video.
When you make a video, you 1. Plan and record your subject, 2. Edit the footage into a sequenced timeline & 3. Export the timeline into a completed video for viewer consumption.
Likewise, when you’re integrating data with notebookSnap, you 1. Record your SQL Queries, PowerShell CommandLets, or any command line script. 2. Ingest your scripts into a database and mark them as sequenced steps, & 3. Execute the project with a built-in runtime for ELT or ETL.
Do you see the comparison?
Furthermore, you can parameterize your workflow, quickly produce with code generators, and best of all, you don’t have to ditch your favorite SQL Editor; instead-- use it!
Quite simply, if you know SQL, then you’ll know notebookSnap. Integrate it with your Azure Data Studio application today and start seeing results in a snap.
BI Tracks Website: www.bitracks.com
eltSnap Webpage: www.bitracks.com/eltsnap
Jim Miller on LinkedIn: www.linkedin.com/in/jmiller8/
zhlédnutí: 1 084

Video

Combine & Backup Notebooks - Getting Started with notebookSnap Pt. 3 | Tutorial
zhlédnutí 33Před 3 lety
This video will show you how to take two different Notebooks, one is SQL and the other is PowerShell, combine them together in a single project and back them up to your SQL Server database. Then we will move those backup files to a new location, which is quite a common process for people keeping a disaster-recovery database. You will see that it can all be done in a snap! notebookSnap Website: ...
Capturing Metadata from SQL Server - Getting Started with notebookSnap Pt. 2 | Tutorial
zhlédnutí 279Před 3 lety
This video will show you how to capture metadata from SQL server. What we’ll do is use a Jupyter Notebook, which has a series of 10 steps, and ingest it into the database. The notebook code cells will now be in the database, which will include a data flow and transformations, that will act as a data mart. This is what is used to populate a data warehouse. We’ll also show you how to use a custom...
The Basics - Getting Started with notebookSnap Pt. 1 | Tutorial
zhlédnutí 57Před 3 lety
This video covers the basics of notebookSnap. You can work in Azure Data Studio, or your favorite SQL editor, to create SQL queries that will populate your ELT or ETL projects. You create the content within Jupyter Notebooks cells and push them to eltSnap (our runtime) to orchestrate what you’ve created in the notebooks. notebookSnap Website: www.bitracks.com/notebooksnap notebookSnap Install V...
Introduction to notebookSnap | Tutorial
zhlédnutí 60Před 3 lety
This video is an introduction to our latest product notebookSnap. The idea behind notebookSnap is to integrate into Microsoft’s Azure Data Studio, which is for data engineers, data scientist, etc., to build ELT & ETL products. Part of the magic is in allowing you to work within a native SQL editor, or any editor you choose, while also leveraging Jupyter Notebooks to perform data flows and trans...
Installing notebookSnap | Tutorial
zhlédnutí 60Před 3 lety
Learn how to install notebookSnap with these instructions: 00:14 Step 1 - Clone from GitHub (using Azure Data Studio) GitHub Repository Link: github.com/Jim-BITracks/notebook_snap_install 01:14 Step 2 - Open “Install Instructions” in ADS 01:43 Step 3 - Install the following 2 ADS extensions: -Notebook Snap -ELTSnap 03:08 Step 4 - Deploy the following 2 .dacpac files to a SQL Server instance: -e...
Workspaces, Files, Folders | VS Code | GitHub Noteboks - Azure Data Studio Webinar
zhlédnutí 1,4KPřed 3 lety
Webinar Record Date: February 11th, 2021 This Azure Data Studio webinar was hosted by BI Tracks lead consultant, Laurie Ukpabi. The topics she covers in this video are: - Files, Folders & Workspaces - Compatibility with VS Code - Sharing Notebooks to GitHub Get to know Laurie: “I am a Business Intelligence Developer with 10 years of experience. I have worked with T-SQL, SSIS, SSRS, SSAS, and Po...
Sharing Notebooks - Azure Data Studio Webinar
zhlédnutí 2,2KPřed 3 lety
Webinar Record Date: Jan 14, 2021 Learn everything about ‘Sharing Notebooks’ from Azure Data Studio in this 30 minute webinar. The topics that were covered: - GitHub Integration - Links & Images - Jupyter Books - Notebook Variables The book “Hands-On Azure Data Studio” (written in a notebook) can be purchased on Amazon here: www.amazon.com/dp/B08HL8QDP1/ref=cm_sw_em_r_mt_dp_IcvYFbM4SV9DX #Azure...
The Basics - Notebooks in Azure Data Studio Webinar
zhlédnutí 10KPřed 3 lety
Webinar Record Date: Dec 3, 2020 Get started with ‘The Basics’ of Azure Data Studio Notebooks in this 30 minute webinar. The topics that were covered: - Text Cells (using Markdown language) - Code Cells - SQL Kernel Notebooks - PowerShell Kernel Notebooks - Python Kernel Notebooks You will also see other aspects of notebooks like analytics & output, sharing notebooks, exporting notebooks and ev...
Build & Run Azure Data Studio Native ELT Packages
zhlédnutí 959Před 3 lety
eltSnap is an ELT (not ETL) platform alternative to SSIS that has it's own built-in Python Runtime. It is integrated in Azure Data Studio, which is open-source and free, and uses it as the front-end. This allows you to bypass Microsoft's expensive SQL Server licensing and also accelerates your development by more than 10x with a code generator approach. This is a sample of eltSnap in action wit...
Revolutionize Your Data Integration Practices with Azure Data Studio - Webinar
zhlédnutí 538Před 3 lety
This webinar shows a high level overview of how to use Azure Data Studio to: - Build SSIS Projects & Packages for Visual Studio - Build & Run Azure Data Studio ‘Native ELT’ Packages - Build & Deploy ‘Azure Data Factory’ Pipelines The presentation itself was made in a Jupyter Notebook within Azure Data Studio. The notebooks themselves are so powerful that we are able to run these packages right ...
Top 5 Time-Saving Extensions in Azure Data Studio
zhlédnutí 17KPřed 3 lety
This video covers our Top 5 Time-Saving Extensions in Azure Data Studio that we use all the time, which by the way is in no particular order. Extensions can be very powerful and they’re a way for the community, not just Microsoft, to add features and functionality to the application for a tailored end-user experience. To learn how to install these extensions to your system, you can view our “In...
How to Install Extensions - Hands On Azure Data Studio Book
zhlédnutí 1,4KPřed 3 lety
Interactive Video Tutorial from Chapter 6 of our book "Hands-On Azure Data Studio" - Installing Extensions This tutorial dives into Azure Data Studio’s extensions marketplace and how to locate and install them on to your system. Extensions can be very useful as they let you extend features and functionality beyond the Azure Data Studio ‘base product’; making it a more tailored application to yo...
Trends in Data Warehousing - Building a Data Warehouse 10x Faster
zhlédnutí 208Před 3 lety
Building a Data Warehouse 10x Faster Podcast Listen to the entire podcast here: www.buzzsprout.com/1324615/5260696 Trends are constantly changing in technology and staying up-to-date with them is an essential part of business. Minky Kernacs, CEO & Founder of Mercurio Analytics, explains how she is seeing a bigger focus on Speed-to-Market, Cloud Integration, Data Governance and much more. By the...
Vendor Lock - Building a Data Warehouse 10x Faster
zhlédnutí 6Před 3 lety
Ep. 1 - Building a Data Warehouse 10x Faster Listen to the entire podcast here: www.buzzsprout.com/1324615/5260696 Topics Covered: - Vendor lock happens when the code is encapsulated in the software - Implementing new technology becomes increasingly difficult - eltSnap is open and transparent BI Tracks Website: www.bitracks.com eltSnap Webpage: www.bitracks.com/eltsnap Jim Miller on LinkedIn: w...
Self-Healing - Building a Data Warehouse 10x Faster
zhlédnutí 5Před 3 lety
Self-Healing - Building a Data Warehouse 10x Faster
Low Price Solution - Building a Data Warehouse 10x Faster
zhlédnutí 4Před 3 lety
Low Price Solution - Building a Data Warehouse 10x Faster
Lowering Costs - Building a Data Warehouse 10x Faster
zhlédnutí 19Před 3 lety
Lowering Costs - Building a Data Warehouse 10x Faster
Data Management for Arizona - Building a Data Warehouse 10x Faster
zhlédnutí 2Před 3 lety
Data Management for Arizona - Building a Data Warehouse 10x Faster
Struggling with Data Stage? - Building a Data Warehouse 10x Faster
zhlédnutí 6Před 3 lety
Struggling with Data Stage? - Building a Data Warehouse 10x Faster
10 Minute Timer - Building a Data Warehouse 10x Faster
zhlédnutí 38Před 3 lety
10 Minute Timer - Building a Data Warehouse 10x Faster
Storytelling with Notebooks - Hands On Azure Data Studio Book Video
zhlédnutí 645Před 3 lety
Storytelling with Notebooks - Hands On Azure Data Studio Book Video
SQL Snippets - Hands On Azure Data Studio Book Video
zhlédnutí 589Před 3 lety
SQL Snippets - Hands On Azure Data Studio Book Video
Your Next Data Integration Tool | eltSnap
zhlédnutí 63Před 3 lety
Your Next Data Integration Tool | eltSnap
Why I Love Notebooks - Azure Data Studio Tutorial
zhlédnutí 416Před 4 lety
Why I Love Notebooks - Azure Data Studio Tutorial
How to Use Python Snippets - Azure Data Studio Tutorial
zhlédnutí 660Před 4 lety
How to Use Python Snippets - Azure Data Studio Tutorial
How to Integrate Your Applications - Azure Data Studio Tutorial
zhlédnutí 246Před 4 lety
How to Integrate Your Applications - Azure Data Studio Tutorial
How to Use Integrated Terminal - Azure Data Studio Tutorial
zhlédnutí 665Před 4 lety
How to Use Integrated Terminal - Azure Data Studio Tutorial
How to Make SandDance Visualizations - Azure Data Studio Tutorial
zhlédnutí 2,4KPřed 4 lety
How to Make SandDance Visualizations - Azure Data Studio Tutorial
How to Create Custom Snippets - Azure Data Studio Tutorial
zhlédnutí 481Před 4 lety
How to Create Custom Snippets - Azure Data Studio Tutorial

Komentáře

  • @Kalaivanan-lc6vb
    @Kalaivanan-lc6vb Před 2 měsíci

    Brilliant....

  • @igluonvinyls
    @igluonvinyls Před 3 měsíci

    Very helpful thanks!!

  • @wesleycaldwell
    @wesleycaldwell Před 6 měsíci

    The "work around" to keep the tab open for the question at the end, which isn't a work around, the point of this is so that when you are looking through files that you don't open a hundred tabs. You either double click the file or double click the tab. Also, I know VS Code, but am new to ADS, so thanks for the tips. I think your videos could be way more helpful and reach a lot more people ( aka views ) by moving through it a bit quicker. But the points that were covered were very practical for some one like me to implement almost all of what was shown right away. So thank you.

  • @robinbonin1502
    @robinbonin1502 Před 8 měsíci

    Where can I find the Snippet code to create and use the variable table?

  • @JulioBacoli
    @JulioBacoli Před 11 měsíci

    My Azure Data Studio have any strange characters and strange behavior when have empty spaces. How I should solve it?

  • @CaribouDataScience
    @CaribouDataScience Před 11 měsíci

    How do I add the plot to a notebook?

  • @tristangwithian4010

    Why add a local connection in Azure Data Studio? Isn't it primarily about connecting to cloud tools/databases?

    • @DookyButter
      @DookyButter Před 2 dny

      Because those connections to the cloud don't work, even a year later. Trust me. I have to use this platform.

  • @LeventeGaborDrNyars

    Unfortunately, in the Azure Data Studio, I deleted localhost, default from Servers. How can I serstore this Localhost to be able to import AdventureWorks2019?

  • @krishnavegi7758
    @krishnavegi7758 Před rokem

    Nice suggestions Mate!

  • @funmania5863
    @funmania5863 Před rokem

    Can you show plz how to connect to Oracle db from data studio

  • @valeri_valenciaa
    @valeri_valenciaa Před rokem

    Thank you for this video!

  • @oluyomifadipe5634
    @oluyomifadipe5634 Před rokem

    Fantastic. Well done

  • @rachwalskimarcin
    @rachwalskimarcin Před rokem

    There is a newby that will use notebooks in Azure Data Studio after this video.

  • @pedrosturmer4673
    @pedrosturmer4673 Před rokem

    Very helpful, useful and straight to the point! Thanks for sharing this knowlodge

  • @pipersolutions
    @pipersolutions Před rokem

    Excellent 👍

  • @akokohjoel9854
    @akokohjoel9854 Před 2 lety

    Pls can you show us how to connect ms access to azure database

  • @satishvish88
    @satishvish88 Před 2 lety

    Can we do table data compare and deployment here

    • @jimmiller3446
      @jimmiller3446 Před 2 lety

      Hi Satish - I'm not aware of an ADS extension for "data compare"

  • @JeremiahPeoples
    @JeremiahPeoples Před 2 lety

    This is amazing! How did you create the visuals?

    • @jimmiller3446
      @jimmiller3446 Před 2 lety

      Glad you liked it Jeremiah! This video was created by my very talented nephew: joe@citnowproductions.com

  • @wpe3
    @wpe3 Před 2 lety

    Thanks for the video. Regarding the question at the end, if I understand it correctly, I believe another way to open multiple files in separate tabs from the Explorer is to double-click the files rather than single click. Then a separate tab is opened.

  • @lbfreeamerican5891
    @lbfreeamerican5891 Před 2 lety

    Good overview. Thanks.

  • @billmanassas7746
    @billmanassas7746 Před 2 lety

    Very informative, thank you.

  • @victorrodas4357
    @victorrodas4357 Před 2 lety

    Great tutorial. Very well explained. Thank you.

  • @kalarts2350
    @kalarts2350 Před 3 lety

    it's so helpful BI thanks

  • @saurabhcool90
    @saurabhcool90 Před 3 lety

    Hi Jim, Thanks for this informative tutorial on notebooks. How to pass data from 1 code cell to another where kernel is different Like 1st cell is Python and 2nd Cell is SQL

    • @bitracks5977
      @bitracks5977 Před 3 lety

      Hi Saurabh, currently you are not able to 'mix' kernels in an Azure Data Studio Notebook. If interested, the capability to 'mix kernels has recently been added to "VSCode" Notebooks, and here is a link that might help: code.visualstudio.com/api/extension-guides/notebook

  • @joshuapayne6351
    @joshuapayne6351 Před 4 lety

    Jim, you are wasted mate! Please, please consider re-filming this video to make it look more professional. I don’t mind it “as-is”, because the content is excellent. However, I believe thousands of viewers must skip over your vid in favour of watching vids which look pretty, but contain poor content. Please, please keep them coming - but pretty them up.

  • @joshuapayne6351
    @joshuapayne6351 Před 4 lety

    Hi Jim, very useful, thank you! Your explanation is very concise and clear. I have tried to find a video to send to a friend which explains this distinctly. Your explanation is spot on and gives some clear examples. I would love to see this video re-filmed with some visuals. I believe a lot of viewers skip over you vid, just because of the presentation.

  • @stevelyle3538
    @stevelyle3538 Před 4 lety

    I'm not so sure the 10 extra steps in VSC w/ ADS extension to get out what just simply comes as you want it to in SSMS is for me.

  • @joediller5346
    @joediller5346 Před 4 lety

    ELT is taking over!

  • @joediller5346
    @joediller5346 Před 4 lety

    I'm excited to learn more about Azure Data Studio

    • @bitracks5977
      @bitracks5977 Před 4 lety

      We'll be posting 2 videos a week for 4 weeks for this series. Stay tuned!

  • @joediller5346
    @joediller5346 Před 4 lety

    Who makes your videos?

  • @GasTechno
    @GasTechno Před 4 lety

    Where can I download eltsnap?

    • @bitracks5977
      @bitracks5977 Před 4 lety

      You can download your free trial here: www.bitracks.com/eltsnap-down...

  • @c-it-nowproductionsllc5576

    Love the music

  • @stevediller9870
    @stevediller9870 Před 4 lety

    Impressive!

  • @stevediller9870
    @stevediller9870 Před 4 lety

    When's the next video?

    • @bitracks5977
      @bitracks5977 Před 4 lety

      Next week we will be dropping two more. Stay tuned!

  • @stevediller9870
    @stevediller9870 Před 4 lety

    Keep up the good work Jim!

  • @GasTechno
    @GasTechno Před 4 lety

    Nice work! Keep it up

  • @c-it-nowproductionsllc5576

    Awesome! Great video

  • @c-it-nowproductionsllc5576

    I'm excited to see the rest of the series!