Tensorflow - Computer Vision

Popular posts from this blog

Atom - Jupyter / Hydrogen

Image
I will show you how to use the Atom editor with Jupyter Notebook to debug Python/Django views using Hydrogen plugin. On the Internet you can find some examples using this setup to debug Python but I found nothing related to Django, so I decided to publish this notes. This is not a high performance setup, because it involves many technologies at several layers. This is more a proof of concept of nowadays technologies which are available to the programmer's toolbox. This notes has been written during the development and improvement of the automated tests of the Virtual Library of FAPESP ( http://www.bv.fapesp.br ). The environment The diagram below shows an actual infrastructure to use this setup in a development environment. Technologies It is not expected that you know all of the technologies in detail, but there are some trick points. This paper is oriented for Python programmer who already use Atom and Jupyter and enjoy explore the edges of these tools. ...
Read more

ETL, SOLID and Design Patterns

ETL, SOLID and Design Patterns Let's discuss here the best practices to implement a ETL - Extraction Transform Load process using SOLID principles and Design Patterns. Pipeline Pattern One design pattern commonly used in ETL (Extract, Transform, Load) processes is the "Pipeline" pattern. The Pipeline pattern is a software architectural pattern where a series of processing steps are connected together to form a data processing pipeline. Each step in the pipeline performs a specific operation on the data, such as extracting data from a source, transforming it into a desired format, and loading it into a target destination. By using the Pipeline pattern, you can modularize and organize your ETL process into smaller, reusable components. Each component focuses on a specific task, making the overall process more manageable and easier to maintain. Additionally, the Pipeline pattern allows for flexibility and scalability, as you can easily add or remove steps in the pipeli...
Read more

Design Patterns - Observer

Design Patterns - Observer A simple Python code example to illustrate the Observer Pattern for an ETL-like scenario. The "Extract Microservice" observes changes in a data source and notifies its registered observers (data extractors) to perform data extraction. We'll use a basic Publisher-Subscriber pattern to demonstrate the concept of the Observer Pattern. Observer interface class Observer: def update(self, data): pass Extract Microservice (Subject) class ExtractMicroservice: def __init__(self): self.observers = [] def register_observer(self, observer): self.observers.append(observer) def unregister_observer(self, observer): self.observers.remove(observer) def notify_observers(self, data): for observer in self.observers: observer.update(data) def start_extraction(self): # Simulate data extraction process data = ["Data 1", "Data 2", "Data 3",...
Read more