Python Archives ~ fitzmoskal https://fitzmoskal.me/tag/python/ You are _here_ Tue, 05 Mar 2024 20:59:04 +0000 en-GB hourly 1 https://wordpress.org/?v=6.9.4 https://fitzmoskal.me/wp-content/uploads/2024/02/cropped-result_880649-32x32.jpeg Python Archives ~ fitzmoskal https://fitzmoskal.me/tag/python/ 32 32 11678478 RAG with Offline LLM https://fitzmoskal.me/rag-with-offline-llm/ Tue, 05 Mar 2024 20:59:03 +0000 https://fitzmoskal.me/?p=1755 During my time as Head of Professional Services for a private Genomics based company I spearheaded an initiative to utilise

The post RAG with Offline LLM appeared first on fitzmoskal.

]]>

During my time as Head of Professional Services for a private Genomics based company I spearheaded an initiative to utilise an open source offline LLM for analysing our Jira, Confluence and Salesforce docs for quick retrieval of process and technical information.

The purpose was twofold,

a) To create a common ‘search’ tool in order to locate a source of truth as to what was configured and where, and

b) To be able to generate process documents very quickly in whole or in part through the use of generative AI.

As these were sensitive company documents, use of a service like ChatGPT was restricted, which is why we opted to trial PrivateGPT with Llama-2-7b amongst other models.

We found RAG to be less than perfect, but it did effectively allow us to search out the right documents. Text generation was better in that we managed to produce good content as an initial template for a process guides, as well as feeding a full process document to generate a RASCI chart. We ran the pilot service on AWS EC2 infrastruture.

The post RAG with Offline LLM appeared first on fitzmoskal.

]]>
1755
VCF File Validation https://fitzmoskal.me/vcf-file-validation/ Mon, 26 Feb 2024 21:08:20 +0000 https://fitzmoskal.me/?p=1497 This script was bourne of necessity to validate VCF files for injestion into Congenica. The platform does it’s own validation

The post VCF File Validation appeared first on fitzmoskal.

]]>
This script was bourne of necessity to validate VCF files for injestion into Congenica. The platform does it’s own validation but the output in case of error is not human-friendly. This directs the user to which line in the VCF file might be at fault.

https://github.com/codefitz/vcf_validation

The post VCF File Validation appeared first on fitzmoskal.

]]>
1497
Kubespray Dependencies https://fitzmoskal.me/kubespray-dependencies/ Mon, 26 Feb 2024 20:31:46 +0000 https://fitzmoskal.me/?p=1495 Anyone who has worked witk Kubespray knows what kind of hell it is to figure out the dependencies. Part of

The post Kubespray Dependencies appeared first on fitzmoskal.

]]>
Anyone who has worked witk Kubespray knows what kind of hell it is to figure out the dependencies. Part of the reason for this is that each version is kept on a seperate branch, and each branch will have it’s own buried readme – which notes the particular version of Python and Ansible is supported. Easy when you know how, but a pain if you’re dealing with complex installation processes and installing dependencies for the first time.

This script I wrote essentially takes a python version or an ansible version and will loop through checking out each branch then printout which versions of Kubespray are supported.

https://github.com/codefitz/kubespray-dependencies

The post Kubespray Dependencies appeared first on fitzmoskal.

]]>
1495
US Retailer – DevOps https://fitzmoskal.me/us-retailer-devops/ Mon, 26 Feb 2024 17:59:58 +0000 https://fitzmoskal.me/?p=1481 I was asked to provide a health check with insights into the clients Discovery operations. I created a custom application

The post US Retailer – DevOps appeared first on fitzmoskal.

]]>

I was asked to provide a health check with insights into the clients Discovery operations. I created a custom application called Pithos – a python-based application which collected data from CMDB and Discovery. This data was then imported into Power BI and we were able to present the following back to the client:

  • High disk utilisation
  • Presence of core dumps
  • Segregated architecture, but no network segregation
  • Sensitive data such as plaintext usernames and passwords stored in unstructured data fields
  • Scan schedules impacting performance

This was followed up with a roadmap of improvements for the client with the option of being delivered by my company.

The post US Retailer – DevOps appeared first on fitzmoskal.

]]>
1481
UK Pharmaceutical – DevOps https://fitzmoskal.me/uk-pharmaceutical-aiops/ Mon, 26 Feb 2024 17:47:33 +0000 https://fitzmoskal.me/?p=1478 I worked with presales to deliver a $55k project with insights into the clients Discovery operations created with Pithos –

The post UK Pharmaceutical – DevOps appeared first on fitzmoskal.

]]>

I worked with presales to deliver a $55k project with insights into the clients Discovery operations created with Pithos – a custom built python-based application which collected data from CMDB and Discovery. This data was then imported into Power BI and we were able to present the following back to the client:

  • Sensitive data filters not capturing plaintext username/password
  • Under-specced Outpost sizes causing performance issues
  • Active user accounts from departed users not removed
  • Various data quality issues
  • Configuration discrepencies between prod and dev environments

This was followed up with a roadmap of improvements for the client which included development of a runbook, and 10 consultancy days of remediation.

The post UK Pharmaceutical – DevOps appeared first on fitzmoskal.

]]>
1478
Mapping Food & Drinks Venues with Foursquare API https://fitzmoskal.me/mapping-food-drinks-venues-with-foursquare-api/ Tue, 20 Feb 2024 14:33:39 +0000 https://fitzmoskal.me/?p=1293 I was given a brief to extract data from Foursquare to identify the nearest food and drinks venues within 1000

The post Mapping Food & Drinks Venues with Foursquare API appeared first on fitzmoskal.

]]>
I was given a brief to extract data from Foursquare to identify the nearest food and drinks venues within 1000 meters latitude and longitude provided in an Excel sheet for a historical tour company.

I developed this with a mixture of Bash and Python, exporting the results to JSON and then converting to CSV. All code was handed to the client.

The post Mapping Food & Drinks Venues with Foursquare API appeared first on fitzmoskal.

]]>
1293
Using the BMC Discovery API https://fitzmoskal.me/using-the-bmc-discovery-api/ Tue, 20 Feb 2024 11:13:53 +0000 https://fitzmoskal.me/?p=1245 This is a course I designed and developed offered by Traversys hosted on Udemy. Similar to the TPL Crash Course,

The post Using the BMC Discovery API appeared first on fitzmoskal.

]]>

This is a course I designed and developed offered by Traversys hosted on Udemy.

Similar to the TPL Crash Course, I sensed there was a demand to understand how to use the API from Discovery adminsitrators who would not have API use as part of their core skillset. At the time of publishing BMC themselves had no training available on API use whatsoever.

The post Using the BMC Discovery API appeared first on fitzmoskal.

]]>
1245
getCert CE https://fitzmoskal.me/getcert-ce/ Mon, 19 Feb 2024 23:10:06 +0000 https://fitzmoskal.me/?p=1236 This is the Community Edition of getCert which is free and open source to download and use with BMC Discovery.

The post getCert CE appeared first on fitzmoskal.

]]>
This is the Community Edition of getCert which is free and open source to download and use with BMC Discovery. This is managed and provided by Traversys.

https://github.com/traversys/getCert_CE

The post getCert CE appeared first on fitzmoskal.

]]>
1236
Tideway https://fitzmoskal.me/tideway/ Mon, 19 Feb 2024 23:02:48 +0000 https://fitzmoskal.me/?p=1232 An I developed in Python for Traversys which simplifies usage of the BMC Discovery API. This is no longer being

The post Tideway appeared first on fitzmoskal.

]]>
An I developed in Python for Traversys which simplifies usage of the BMC Discovery API. This is no longer being actively developed since we’ve moved away from working on Discovery.

https://github.com/traversys/Tideway

The post Tideway appeared first on fitzmoskal.

]]>
1232
WhenWasThat https://fitzmoskal.me/whenwasthat/ Mon, 19 Feb 2024 22:36:35 +0000 https://fitzmoskal.me/?p=1219 This is a small script using Python Pandas that takes a date input and can tell how exactly how long

The post WhenWasThat appeared first on fitzmoskal.

]]>
This is a small script using Python Pandas that takes a date input and can tell how exactly how long ago the event took place in human readable syntax.

https://github.com/codefitz/WhenWasThat

The post WhenWasThat appeared first on fitzmoskal.

]]>
1219