-
Notifications
You must be signed in to change notification settings - Fork 3
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
145ab67
commit 49b2ef3
Showing
97 changed files
with
44,100 additions
and
40,813 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,29 +1,30 @@ | ||
| .Rproj.user | ||
| .Rhistory | ||
| .RData | ||
| .Ruserdata | ||
| Introd-pyspark.pdf | ||
|
|
||
| /.quarto/ | ||
|
|
||
| derby.log | ||
| Chapters/derby.log | ||
|
|
||
| spark-warehouse | ||
| Chapters/spark-warehouse | ||
| metastore_db | ||
| Chapters/metastore_db | ||
|
|
||
| Chapters/*.html | ||
| Chapters/*/* | ||
|
|
||
| Scripts/__pycache__/ | ||
|
|
||
| index_files/ | ||
|
|
||
| Introduction-to-`pyspark`.tex | ||
| index.tex | ||
| docs/*.pdf | ||
| *.aux | ||
| *.log | ||
| *.toc | ||
| .Rproj.user | ||
| .Rhistory | ||
| .RData | ||
| .Ruserdata | ||
| Introd-pyspark.pdf | ||
|
|
||
| /.quarto/ | ||
| site_libs/ | ||
|
|
||
| derby.log | ||
| Chapters/derby.log | ||
|
|
||
| spark-warehouse | ||
| Chapters/spark-warehouse | ||
| metastore_db | ||
| Chapters/metastore_db | ||
|
|
||
| Chapters/*.html | ||
| Chapters/*/* | ||
|
|
||
| Scripts/__pycache__/ | ||
|
|
||
| index_files/ | ||
|
|
||
| Introduction-to-`pyspark`.tex | ||
| index.tex | ||
| docs/*.pdf | ||
| *.aux | ||
| *.log | ||
| *.toc |
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,50 +1,50 @@ | ||
|
|
||
| # Opening the terminal of your OS {#sec-open-terminal .appendix} | ||
|
|
||
| Every operating system (OS) comes with a terminal (or a command prompt). A terminal is usually just a black screen where you can send commands to be executed by your OS. As an example, @fig-terminal-simple-shot shows a print screen of the terminal in Ubuntu Linux. The terminal on Windows is very similar to this. | ||
|
|
||
| {#fig-terminal-simple-shot} | ||
|
|
||
| Terminals are incredibely flexible tools, and you will find this tool very useful for a number of things. However, since they are just a black and empty screen, they give you no clue of what you should do, or what commands are available to you. | ||
|
|
||
| That is ok, for now, you should not worry about that. I will expose many terminal commands in this book, and these commands should be used inside these terminals that comes with your OS. The next sub-sections will show you how to open a terminal in each one of the OS's where Spark is available. Lets begin with Windows. | ||
|
|
||
| ### Opening a terminal on Windows | ||
|
|
||
| There are some different approaches to do this, but, the one that I find the most useful, is to open a terminal from inside a folder, using the default File Explorer program of Windows. | ||
|
|
||
| This is very useful, because we normally use terminal commands to affect a set of files that are stored inside a specific folder in our computer. | ||
|
|
||
| As a result, when we open a terminal from inside a folder, using the File Explorer, the terminal opened is already rooted inside the folder where our files are stored. In other words, we already have easy access to the files that we want to affect/use in our command, and we do not have the work to change or adjust directories in this terminal. | ||
|
|
||
| For example, lets suppose that we want to use a terminal command to use a file called `hello.py`, and, that this `hello.py` file is stored inside a folder called `HelloPython`. You can see in @fig-windows-hello-folder, that this folder is in path `C:\Users\pedro\Documents\HelloPython`. So, the first step, is to use the File Explorer of Windows, to open this folder, like in @fig-windows-hello-folder. | ||
|
|
||
| {#fig-windows-hello-folder fig-align="center"} | ||
|
|
||
|
|
||
| After you opened this folder, substitute the path to the folder in the search box with the word "cmd", like in @fig-windows-hello-folder2, and them, press Enter in the keyboard. | ||
|
|
||
| {#fig-windows-hello-folder2 fig-align="center"} | ||
|
|
||
|
|
||
| As a result, a new terminal will open. See in @fig-windows-terminal, that this new terminal is already looking to (or is already rooted on) this `HelloPython` folder. This way, we can easily access the files stored inside this folder, like the `hello.py` file. | ||
|
|
||
| {#fig-windows-terminal fig-align="center"} | ||
|
|
||
|
|
||
| ### Opening a terminal on Linux | ||
|
|
||
| Is fairly easy to open a terminal on a Linux distribution. Again, is very useful when you open the terminal from inside the folder you are interested in. Because you will have an easier access to all the files that are stored inside this folder. | ||
|
|
||
| To do this in Linux, you use the built-in File Explorer to open the folder where you want to root your terminal. At the moment, I am using an Ubuntu distribution. I just opened the same `HelloPython` folder, with the same `hello.py` file, in the File Explorer of Linux. As shown in @fig-ubuntu-folder: | ||
|
|
||
| {#fig-ubuntu-folder fig-align="center"} | ||
|
|
||
| After you opened the folder, just click with the right button of your mouse, and select the "Open in Terminal" option, and a new terminal should appear on your screen. See in @fig-ubuntu-folder-terminal, that the new terminal is already looking to the `HelloPython` folder, as we expected. | ||
|
|
||
| {#fig-ubuntu-folder-terminal fig-align="center"} | ||
|
|
||
| ### Opening a terminal in MacOs | ||
|
|
||
| Unfortunately, I do not have a Mac machine in my possession, so I cannot easily show you how to open a terminal in MacOs. But there a lot of articles available in the internet discussing how to open a terminal in MacOs. For example, there is a article from the support of Apple^[<https://support.apple.com/en-ie/guide/terminal/apd5265185d-f365-44cb-8b09-71a064a42125/mac>], or this other article from iDownloadBlog^[<https://www.idownloadblog.com/2019/04/19/ways-open-terminal-mac/>]. | ||
|
|
||
|
|
||
| # Opening the terminal of your OS {#sec-open-terminal .appendix} | ||
|
|
||
| Every operating system (OS) comes with a terminal (or a command prompt). A terminal is usually just a black screen where you can send commands to be executed by your OS. As an example, @fig-terminal-simple-shot shows a print screen of the terminal in Ubuntu Linux. The terminal on Windows is very similar to this. | ||
|
|
||
| {#fig-terminal-simple-shot} | ||
|
|
||
| Terminals are incredibely flexible tools, and you will find this tool very useful for a number of things. However, since they are just a black and empty screen, they give you no clue of what you should do, or what commands are available to you. | ||
|
|
||
| That is ok, for now, you should not worry about that. I will expose many terminal commands in this book, and these commands should be used inside these terminals that comes with your OS. The next sub-sections will show you how to open a terminal in each one of the OS's where Spark is available. Lets begin with Windows. | ||
|
|
||
| ### Opening a terminal on Windows | ||
|
|
||
| There are some different approaches to do this, but, the one that I find the most useful, is to open a terminal from inside a folder, using the default File Explorer program of Windows. | ||
|
|
||
| This is very useful, because we normally use terminal commands to affect a set of files that are stored inside a specific folder in our computer. | ||
|
|
||
| As a result, when we open a terminal from inside a folder, using the File Explorer, the terminal opened is already rooted inside the folder where our files are stored. In other words, we already have easy access to the files that we want to affect/use in our command, and we do not have the work to change or adjust directories in this terminal. | ||
|
|
||
| For example, lets suppose that we want to use a terminal command to use a file called `hello.py`, and, that this `hello.py` file is stored inside a folder called `HelloPython`. You can see in @fig-windows-hello-folder, that this folder is in path `C:\Users\pedro\Documents\HelloPython`. So, the first step, is to use the File Explorer of Windows, to open this folder, like in @fig-windows-hello-folder. | ||
|
|
||
| {#fig-windows-hello-folder fig-align="center"} | ||
|
|
||
|
|
||
| After you opened this folder, substitute the path to the folder in the search box with the word "cmd", like in @fig-windows-hello-folder2, and them, press Enter in the keyboard. | ||
|
|
||
| {#fig-windows-hello-folder2 fig-align="center"} | ||
|
|
||
|
|
||
| As a result, a new terminal will open. See in @fig-windows-terminal, that this new terminal is already looking to (or is already rooted on) this `HelloPython` folder. This way, we can easily access the files stored inside this folder, like the `hello.py` file. | ||
|
|
||
| {#fig-windows-terminal fig-align="center"} | ||
|
|
||
|
|
||
| ### Opening a terminal on Linux | ||
|
|
||
| Is fairly easy to open a terminal on a Linux distribution. Again, is very useful when you open the terminal from inside the folder you are interested in. Because you will have an easier access to all the files that are stored inside this folder. | ||
|
|
||
| To do this in Linux, you use the built-in File Explorer to open the folder where you want to root your terminal. At the moment, I am using an Ubuntu distribution. I just opened the same `HelloPython` folder, with the same `hello.py` file, in the File Explorer of Linux. As shown in @fig-ubuntu-folder: | ||
|
|
||
| {#fig-ubuntu-folder fig-align="center"} | ||
|
|
||
| After you opened the folder, just click with the right button of your mouse, and select the "Open in Terminal" option, and a new terminal should appear on your screen. See in @fig-ubuntu-folder-terminal, that the new terminal is already looking to the `HelloPython` folder, as we expected. | ||
|
|
||
| {#fig-ubuntu-folder-terminal fig-align="center"} | ||
|
|
||
| ### Opening a terminal in MacOs | ||
|
|
||
| Unfortunately, I do not have a Mac machine in my possession, so I cannot easily show you how to open a terminal in MacOs. But there a lot of articles available in the internet discussing how to open a terminal in MacOs. For example, there is a article from the support of Apple^[<https://support.apple.com/en-ie/guide/terminal/apd5265185d-f365-44cb-8b09-71a064a42125/mac>], or this other article from iDownloadBlog^[<https://www.idownloadblog.com/2019/04/19/ways-open-terminal-mac/>]. | ||
|
|
Oops, something went wrong.