Reminder - installing podman and skopeo on Ubuntu 22.04

This follows on from: -

Lest I forget - how to install pip on Ubuntu

I had reason to install podman and skopeo on an Ubuntu box: -

lsb_release -a

No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 22.04.5 LTS
Release: 22.04
Codename: jammy

having updated Ubuntu: -

apt-get update && apt-get upgrade -y

but both: -

apt-get install -y podman

and: -

apt-get install -y skopeo

gave me sadness responses: -

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
E: Unable to locate package podman

and: -

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
E: Unable to locate package skopeo

respectively.

And then I remembered ...

As for pip I needed to enable the universe ...

by updating /etc/apt/sources.list to include: -

deb http://us.archive.ubuntu.com/ubuntu jammy universe
deb http://us.archive.ubuntu.com/ubuntu jammy-updates universe

Once I did this, and re-ran apt-get update I was off to the races ...

Now, will I remember this tomorrow ? :-) 

Note to self - use kubectl to query images in a pod or deployment

In both cases, we use JSON ...

For a deployment, we can do this: -

kubectl get deployment foobar --namespace snafu --output jsonpath="{..image}"

which returns the image name(s) on the same line

Or we can do this: -

kubectl get deployment foobar --namespace snafu --output JSON | jq -r '.spec.template.spec.containers[].image'

which does much the same, although with each image on a separate line 'cos formatting

Alternatively, we can examine the pod: -

kubectl get pods --namespace snafu --selector app=foobar --output jsonpath="{..image}"

which, again, returns the image(s) on the same line, but for each pod in the deployment - which perhaps leads to duplication

For me, kubectl get deployment is simpler ...

Lest I forget - how to install pip on Ubuntu

 I seem to forget to remember this almost monthly, every time I spin up a new Ubuntu VM

This time around, it's Ubuntu 22.04 and I'm trying to install python3-pip ( aka pip3 or just pip )

apt-get install -y python3-pip

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Package python3-pip is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source

E: Package 'python3-pip' has no installation candidate

Ah, of course, it's sources.list as ever ...

cat <<EOF >> /etc/apt/sources.list
deb http://us.archive.ubuntu.com/ubuntu jammy universe
deb http://us.archive.ubuntu.com/ubuntu jammy-updates universe
EOF

and now apt-get install -y python3-pip is happy
 

ls -al $(which pip)

-rwxr-xr-x 1 root root 221 Nov 10  2023 /usr/bin/pip

ls -al $(which pip3)

-rwxr-xr-x 1 root root 221 Nov 10  2023 /usr/bin/pip3

Visual Studio Code - Wow 🙀

Why did I not know that I can merely hit [cmd] [p] to bring up a search box allowing me to search my project e.g. a repo cloned from GitHub etc. for a file name ?

How long have I spent manually navigating the folder structure on the left-hand side ?

🙀🙀🙀

Getting started with Python in Jupyter Notebooks

So, as we get ready to start a new year, I'm tinkering with a bunch of new ( to me ) tech toys, including wrangling Python dependencies.

Having spent much of of the past year or so using pip and pyenv to manage Python dependencies, more recently, I've been looking at an alternate solution, Anaconda.

Having downloaded and installed the Mac version of Anaconda - and allowed it to install itself into ~/.zshrc ( as I use Z Shell rather than, say, Bash ), when I start a new Terminal window ( I'm using iTerm 3.4.23 on macOS 14.2.1 ), I automatically open up in a virtual environment called base 

conda env list

# conda environments:

#

base                  *  /Users/hayd/anaconda3

type conda

conda is a shell function from /Users/hayd/.zshrc

This also gives me access to Jupyter : -

type jupyter

jupyter is /Users/hayd/anaconda3/bin/jupyter

jupyter notebook

  _   _          _      _

 | | | |_ __  __| |__ _| |_ ___

 | |_| | '_ \/ _` / _` |  _/ -_)

  \___/| .__/\__,_\__,_|\__\___|

       |_|

Read the migration plan to Notebook 7 to learn about the new features and the actions to take if you are using extensions.

https://jupyter-notebook.readthedocs.io/en/latest/migrate_to_notebook7.html

Please note that updating to Notebook 7 might break some of your extensions.

[W 15:06:56.602 NotebookApp] Loading JupyterLab as a classic notebook (v6) extension.

[I 2023-12-29 15:06:56.605 LabApp] JupyterLab extension loaded from /Users/hayd/anaconda3/lib/python3.11/site-packages/jupyterlab

[I 2023-12-29 15:06:56.605 LabApp] JupyterLab application directory is /Users/hayd/anaconda3/share/jupyter/lab

[I 15:06:57.709 NotebookApp] Serving notebooks from local directory: /Users/hayd

[I 15:06:57.709 NotebookApp] Jupyter Notebook 6.5.4 is running at:

[I 15:06:57.709 NotebookApp] http://localhost:8888/?token=707355ee0dd1f8fd9bf4e7124b83d1126a024cc4606eade0

[I 15:06:57.709 NotebookApp]  or http://127.0.0.1:8888/?token=707355ee0dd1f8fd9bf4e7124b83d1126a024cc4606eade0

[I 15:06:57.709 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).

[C 15:06:57.711 NotebookApp]

    To access the notebook, open this file in a browser:

        file:///Users/hayd/Library/Jupyter/runtime/nbserver-33550-open.html

    Or copy and paste one of these URLs:

        http://localhost:8888/?token=707355ee0dd1f8fd9bf4e7124b83d1126a024cc4606eade0

     or http://127.0.0.1:8888/?token=707355ee0dd1f8fd9bf4e7124b83d1126a024cc4606eade0

0.00s - Debugger warning: It seems that frozen modules are being used, which may

0.00s - make the debugger miss breakpoints. Please pass -Xfrozen_modules=off

0.00s - to python to disable frozen modules.

0.00s - Note: Debugging will proceed. Set PYDEVD_DISABLE_FILE_VALIDATION=1 to disable this validation.

which automatically opens up a browser tab: -

Jupyter Notebook localhost

jupyter notebook list

Currently running servers:

http://localhost:8888/?token=707355ee0dd1f8fd9bf4e7124b8ad1126a024cc4606eade0 :: /Users/hayd

shows me the running notebook, plus it's port AND authentication token :-)

With the Jupyter server running, I quickly created a new Python3 ( pykernel ) notebook: -

and am off to the races: -

For reference, I'm working on watsonx.ai as a coder at present, and am running through some of the Python-based prompt engineering tutorials, and wanted a place to test the generated Python code

This was of use, in terms of getting me started: -

How to Use Jupyter Notebook: A Beginner's Tutorial

More on macOS SMB sharing

As a follow-up to an earlier post: -

macOS to macOS File Sharing - Don't work, try The IT Crowd

I hit this problem again and referred back to my post, and also to Dan's post: -

Solving a file sharing mystery: Why one Mac can't see another

digging further into the firewall settings on my Mac mini

Having noticed that smbd did NOT appear in the list returned by 

/usr/libexec/ApplicationFirewall/socketfilterfw —listapps

I looked again at the firewall settings: -

and explicitly added smbd via it's path: -

/usr/sbin/smbd

and also enabled smbd via 

 /usr/libexec/ApplicationFirewall/socketfilterfw --unblockapp /usr/sbin/smbd

Incoming connection to the application is permitted

Now it looks better: -

/usr/libexec/ApplicationFirewall/socketfilterfw --listapps

ALF: total number of apps = 4

1 :  /System/Library/CoreServices/ControlCenter.app

  ( Allow incoming connections )

2 :  /Applications/Firefox.app/Contents/MacOS/updater.app

  ( Allow incoming connections )

3 :  /usr/sbin/smbd

  ( Allow incoming connections )

4 :  /System/Library/CoreServices/UniversalControl.app

  ( Allow incoming connections )

and, even better, I can access the Mac Mini via SMB from other Macs without issues

Nice !

Why I can't install jq on Ubuntu 20.04

 A friend asked me why they were unable to install jq onto their Ubuntu 20.04 Linux box - which seems like a perfectly reasonable to do / ask.

 

So I tried ...

 

And failed ...

 

lsb_release -a

 

No LSB modules are available.
Distributor ID:    Ubuntu
Description:    Ubuntu 20.04.6 LTS
Release:    20.04
Codename:    focal

uname -a

Linux foobar.snafu.com 5.4.0-156-generic #173-Ubuntu SMP Tue Jul 11 07:25:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

apt-get update && apt-get upgrade -y

 

apt-get install -y jq

Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package jq

Having read the jq download page, which says, in part: -

 

jq is in the official Debian and Ubuntu repositories. Install using sudo apt-get install jq.

I was confused, to say the least ....

And then I remembered to check the Aptitude Package Manager's sources.list file : -

cat /etc/apt/sources.list

# See http://help.ubuntu.com/community/UpgradeNotes for how to upgrade to
# newer versions of the distribution.
deb http://us.archive.ubuntu.com/ubuntu focal main
# deb-src http://us.archive.ubuntu.com/ubuntu focal main restricted

## Major bug fix updates produced after the final release of the
## distribution.
deb http://us.archive.ubuntu.com/ubuntu focal-updates main
# deb-src http://us.archive.ubuntu.com/ubuntu focal-updates main restricted

## N.B. software from this repository is ENTIRELY UNSUPPORTED by the Ubuntu
## team. Also, please note that software in universe WILL NOT receive any
## review or updates from the Ubuntu security team.
# deb-src http://us.archive.ubuntu.com/ubuntu focal universe
# deb-src http://us.archive.ubuntu.com/ubuntu focal-updates universe

## N.B. software from this repository is ENTIRELY UNSUPPORTED by the Ubuntu
## team, and may not be under a free licence. Please satisfy yourself as to
## your rights to use the software. Also, please note that software in
## multiverse WILL NOT receive any review or updates from the Ubuntu
## security team.
# deb-src http://us.archive.ubuntu.com/ubuntu focal multiverse
# deb-src http://us.archive.ubuntu.com/ubuntu focal-updates multiverse

## N.B. software from this repository may not have been tested as
## extensively as that contained in the main release, although it includes
## newer versions of some applications which may provide useful features.
## Also, please note that software in backports WILL NOT receive any review
## or updates from the Ubuntu security team.
deb http://us.archive.ubuntu.com/ubuntu focal-backports main
# deb-src http://us.archive.ubuntu.com/ubuntu focal-backports main restricted universe multiverse

## Uncomment the following two lines to add software from Canonical's
## 'partner' repository.
## This software is not part of Ubuntu, but is offered by Canonical and the
## respective vendors as a service to Ubuntu users.
# deb http://archive.canonical.com/ubuntu focal partner
# deb-src http://archive.canonical.com/ubuntu focal partner

deb http://us.archive.ubuntu.com/ubuntu focal-security main
# deb-src http://us.archive.ubuntu.com/ubuntu focal-security main restricted
# deb-src http://us.archive.ubuntu.com/ubuntu focal-security universe
# deb-src http://us.archive.ubuntu.com/ubuntu focal-security multiverse

or, more specifically, looking for the Ubuntu Universe repository : -

cat /etc/apt/sources.list|grep -i universe

## team. Also, please note that software in universe WILL NOT receive any
# deb-src http://us.archive.ubuntu.com/ubuntu focal universe
# deb-src http://us.archive.ubuntu.com/ubuntu focal-updates universe
# deb-src http://us.archive.ubuntu.com/ubuntu focal-backports main restricted universe multiverse
# deb-src http://us.archive.ubuntu.com/ubuntu focal-security universe

which showed that universe wasn't enabled ...

So I backed up the existing /etc/apt/source.list file: -

cp /etc/apt/sources.list /etc/apt/sources.list.ORIG

 

and then added the universe repo: -

 

cat <<EOF >> /etc/apt/sources.list
deb http://us.archive.ubuntu.com/ubuntu focal universe
deb http://us.archive.ubuntu.com/ubuntu focal-updates universe
deb http://us.archive.ubuntu.com/ubuntu focal-security universe
EOF

and tried again: -

apt-get update && apt-get install -y jq

Reading package lists... Done
Building dependency tree
Reading state information... Done
The following additional packages will be installed:
  libjq1 libonig5
The following NEW packages will be installed:
  jq libjq1 libonig5
0 upgraded, 3 newly installed, 0 to remove and 0 not upgraded.
Need to get 313 kB of archives.
After this operation, 1,062 kB of additional disk space will be used.
Get:1 http://us.archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB]
Get:2 http://us.archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB]
Get:3 http://us.archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB]
Fetched 313 kB in 1s (440 kB/s)
Selecting previously unselected package libonig5:amd64.
(Reading database ... 108600 files and directories currently installed.)
Preparing to unpack .../libonig5_6.9.4-1_amd64.deb ...
Unpacking libonig5:amd64 (6.9.4-1) ...
Selecting previously unselected package libjq1:amd64.
Preparing to unpack .../libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ...
Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ...
Selecting previously unselected package jq.
Preparing to unpack .../jq_1.6-1ubuntu0.20.04.1_amd64.deb ...
Unpacking jq (1.6-1ubuntu0.20.04.1) ...
Setting up libonig5:amd64 (6.9.4-1) ...
Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ...
Setting up jq (1.6-1ubuntu0.20.04.1) ...
Processing triggers for man-db (2.9.1-1) ...
Processing triggers for libc-bin (2.31-0ubuntu9.12) ...

and now things are happy: -

jq --version

jq-1.6

cat ~/family.json | jq

{
  "friends": [
    {
      "givenName": "Dave",
      "familyName": "Hay"
    },
    {
      "givenName": "Homer",
      "familyName": "Simpson"
    },
    {
      "givenName": "Marge",
      "familyName": "Simpson"
    },
    {
      "givenName": "Lisa",
      "familyName": "Simpson"
    },
    {
      "givenName": "Bart",
      "familyName": "Simpson"
    }
  ]
}