PYTHONPython is an open source and multi-platforminterpreted language that does not have to be complied to run. Python interpreters are available from where commands and scripts can be executed. It is readable and very easy to interface with other languages and user-friendly data structures that can be used to construct fast runtime data structures.It is a language for which a large variety of high-quality packages are available for various applications, from web frameworks to scientific computing. Provides a large standard library which includes areas like internet protocols, string operations, web services tools and operating system interfaces.
XMLXML is a software and hardware independent tool for storing and transporting data. It is used to simplify data storage and data sharing. It is to outsource data. Instead of integrating them into the HTML document, they are stored in separate XML files. Since XML stores data in a plain text format, the storage is independent of your platform and your data can be exported, imported or simply moved quite easily.
ODOO FRAMEWORKOdoo Framework uses the open source python programming language along with PostgreSQL for data storage. The views in Odoo are dynamically created using XML codes that are viewed in frontend which is the user interface.Odoo has its own API framework and its own templating language - QWeb which is used as a primary template engine used in Odoo to generate HTML pages. Reports are written either in HTML or Qweb. An Odoo Framework combined with all the above helps to build a comprehensive business application.
POSTGRESQLPostgreSql is an open source object relational database. It uses and extends the SQL language combined with many features that safely store and scale the most complicated data workloads.It is one of the most reliable databases with extensive focus on data reliability and correctness and security.
JAVAJava is a high-level programming language mainly used in client server web applications. It is con-current, class based and object oriented. Today Java platform is a commonly used foundation for developing and delivering content to the web. Being platform independent, Java was designed to be easy to use, write, compile, debug. Object-Oriented allows you to create modular programs and reusable code. Platform-independent meaning ability to move easily from one system to another.
SPRINGBOOTSpring boot is a brand-new framework from the team at Pivotal, designed to simplify the bootstrapping and development of a new spring application. Spring boot is used as framework to the application server where Java programming can be used for various operations.It can be quickly setup and run standalone web applications and micro services at very short time.
SPRINGMVCSpring MVC framework provides a Model-View-Controller (MVC) architecture and ready components that can be used to develop flexible and loosely coupled web applications.This framework is designed around a Dispatcher Servlet that handles all the HTTP requests and responses.It provides a comprehensive infrastructure support for developing Java based applications. Spring MVC also enables the developer to create high performing, reusable, easily testable and loose coupling enterprise Java applications.
HIBERNATEHibernate ORM (Hibernate in short) is an Object-Relational apping tool for the Java programming language. It provides a framework for mapping an object-oriented domain model to a relational database.Hibernate can be used to do the relational mapping with DB.It’s mainly used because of itsdatabase independent, JPA Provider- Java persistence API (JPA), built-in connection pool implementation and layered architecture.
MYSQLMySQL is an Open Source Relational SQL Database Management System based on Structured Query Language (SQL).MySQL is one of the best RDBMS that is used for developing various web-based software applications.MySQL is easy to use, yet extremely powerful, secure and scalable. Due to its small size and speed, it is the ideal database solution for websites.
MSSQLMSSQL is a relational web hosting database that is used to store web site information like blog posts or user information. It is the most popular type of database on Windows servers. It is not free, but it has many advanced features that make it suitable for businesses. The MSSQL database can store any type of data you want. It allows you to store and retrieve information quite fast and multiple web site visitors can use it at one time.
BOOTSTRAPBootstrap framework helps design responsive web development applications and websites. It is compatible with all the devices and with its framework, developments can be done quite fast. It is internally consistent, so it makes the design’s look and feel familiar with the user on every platform. The key advantage of this framework is that it designs only what the end user requires rather than showing options and features that the users don’t care about.
MATERIAL DESIGNMaterial Design is an android-oriented design language.It outlines how an app should look and behave. It provides a layering that involves stacking multiple elements, like a deck of cards to create a single unified experience across the application. It helps in a faster design consistency in the UI and UX across all device types.
IONIC 3Ionic is an opensource framework that allows the creation of highly interactive, cross-platform mobile apps that can be deployed across different smartphones (android, iOS,windows) and web.It provides mobile friendly HTML,CSS and JS CSS components. It provides tools and services for hybrid mobile apps using the above-mentioned web technologies.It gives a lot of UI components for creating robust and rich apps that can run on different platforms.
SQLITESQLite is an embedded SQL database that provides a relational database management system. Its light in terms of setup,database administration and resource required. SQLite does not have a separate server process. It reads and writes directly to ordinary disk files. A complete SQL database with multiple tables, indices, triggers and views, is contained in a single disk file. It allows a single database connection to access multiple database files simultaneously. It can create an in-memory database which is very fast to work with.
FIREBASEFirebase is a platform that builds web and mobile applications without server-side programming language. It can store data on its real time database which sync data among user’s data in no time.It has built-in analytics that has audience segmentation, unlimited reporting and integration with multiple services. It helps in creating and developing high quality applications with authentication, remote config,storage in real time database, cloud messaging etc.
MONGODBAn opensource database that uses a document-oriented data model and a non-structured query language. It is one of the most powerful No SQL systems and databases.It is most suited for mission-critical applications as it reduces risks. It builds applications that are not possible with traditional databases. Efficient, scale-out architecture instead of monolithic architecture.The ability to handle high volumes of structured, semi-structured and unstructured data and is better aligned with object-oriented programming.
NIFINiFi is an integrated data logistics platform for automating the movement of data between systems.It allows a user to send, receive, route, transform and sort data, as needed, in an automated and configurable way. It supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic. NiFi is different from other tools because of its user-friendly drag-and-drop graphical user interface and the ease with which it can be customised on the fly for specific needs.
SSISSSIS - Microsoft Integration Services is a platform for building enterprise-level data integration and data transformation solutions. It usesintegration services to solve complex business problems by copying or downloading files, loading data warehouses, cleansing and mining data and managing SQL Server objects and data.The primary use for SSIS is data warehousing as the product features a fast and flexible tool for data extraction, transformation, and loading (ETL).This tool can also be used to automate maintenance of SQL Server databases, update multidimensional cube dataand perform other functions.
ADFAzure Data Factory is a hybrid data integration service that allows you to create, schedule and orchestrate your ETL/ELT workflows at scale wherever your data lives, in cloud or self-hosted networks. Meet your security and compliance needs while taking advantage of ADF’s extensive capabilities. It is used to ingest datafrom multiple on-premises and cloud sources, schedule and manage your data transformation and analysis process. You can choose from a wide range of processing servicesand put them into managed data pipelines to use the best tool for the job. It monitors and manages your network of data pipelines at a glance to identify issues and take action.
SQOOPSqoop is a tool designed to transfer data between Hadoop and relational databases. You can use Sqoop to import data from a relational database management system (RDBMS) such as MySQL or Oracle into the Hadoop Distributed File System (HDFS), transform the data in Hadoop Map Reduce and then export the data back into an RDBMS.
RR programming language is an extensive catalogue mainly dealing with the statistical computation of data and graphical representations. It includes machine learning algorithm, linear regression, time series and statistical inference. It is mostly used for data manipulation, calculation and data visualisation.
SPARKApache Spark: A parallel processing framework that supports in-memory processing to boost the performance of big-data analysis applications. Spark works for SQL, streaming data and machine learning. Spark solves similar problems as Hadoop Map Reduce does but with a fast in-memory approach and a clean functional style API.
STORMA distributed, real-time computation system for processing large streams of data fast. Storm is offered as a managed cluster in HDInsight. It is compatible with multiple languages, extremely fast for processing through large datasets, scalable and fault-tolerant.
FLINKApache Flink is an open source stream processing framework developed by the Apache Software Foundation. The core of Apache Flink is a distributed streaming dataflow engine written in Java and Scala.Flink executes arbitrary dataflow programs in a data-parallel and pipelined manner.Flink's pipelined runtime system enables the execution of bulk/batch and stream processing programs.Flink's runtime also supports the execution of iterative algorithms natively.
KAFKAAn open-source platform that is used for building streaming data pipelines and applications. Kafka also provides a message-queue functionality that allows you to publish and subscribe to data streams. High-throughput: Kafka is capable of handling high-velocity and high-volume data using a not so large hardware. It can support message throughput of thousands of messages per second.Low latency: Kafka can handle these messages with a very low latency of the range of milliseconds, demanded by most of the new use cases. Fault tolerant: The inherent capability of Kafka to be resistant to node/machine failure within a cluster. Durability: The data/messages are persistent on the disk, making it durable and the messages are also replicated.
HDFSHDFS is the primary data storage system used by Hadoop applications. It is used to scale a single cluster to hundreds (and even thousands) of nodes. It is a distributed file system that handles large data sets running on commodity hardware. HDFS provides a reliable means for managing pools of big data and supporting related big data analytics applications.
HBASEApache HBase: A NoSQL database built on Hadoop that provides random access and strong consistency for large amounts of unstructured and semi-structured data--potentially billions of rows times millions of columns. HBase supports random, real-time read/write access with a goal of hosting very large tables atop clusters of commodity hardware.
CASSANDRAApache Cassandra the open source distributed database is a highly scalable, high-performance distributed database designed to handle large amounts of data across many commodity servers, providing high availability with no single point of failure. It is a type of NoSQL database. Cassandra follows a peer-to-peer architecture, instead of master-slave architecture. Hence, there is no single point of failure, its cluster can be easily scaled-up or scaled-down. Data replication makes Cassandra highly available and fault-tolerant. Replication means each data is stored at more than one location, has a very high-level data model – this is column-oriented. This means Cassandra stores columns based on the column names, leading to very quick slicing, building a centralized storage for logs and metrics and retrieving historical information from this storage is a task Cassandra deals with utmost ease.
REDIS DBRedis is an open-source (BSD-licensed), in-memory data structure store used as a database, cache, and message broker. It supports data structures such as strings, hashes, lists, sets and sorted sets with range queries, bitmaps, hyperloglogsand geospatial indexes with radius queries.It helps in developing an efficient caching mechanism and only takes a couple of minutes to implement it with any application.The outcome is a high performing cache system.
SPARK SQLSpark SQL is an interface that works with structured and semi structured data. Using Spark SQL, we can query data, both from inside a Spark program and from external tools that connect through standard database connectors (JDBC/ODBC) to Spark SQL.
SPARK MLSpark ML standardises APIs for machine learning algorithms to make it easier to combine multiple algorithms into a single pipeline or workflow. It aims to provide a uniform set of high-level APIs that help users create and tune practical machine learning pipelines.
TENSORFLOWTensor Flow is a python-friendly opensource library for data flow programming for various range of tasks that is used for numerical computation and large-scale machine learning application.It makes the machine learning faster and easier.The single biggest benefit Tensor Flow provides for machine learning development is abstraction. Instead of dealing with the nitty-gritty details of implementing algorithms or figuring out proper ways to hitch the output of one function to the input of another, the developer can focus on the overall logic of the application. Tensor Flow takes care of the details behind the scenes.
POWER BIPower BI is a cloud-based business analytics that gives you a single view of your most critical business data.It has a rich personalised dashboard that can be customised to meet the exact need of an enterprise, it can easily embed the dashboard and BI reports for user experience, publish reports securely that help to setup automatic data refresh and publish that helps to have the latest information. With a powerful cloud environment, it eliminates memory and speed constraints that ensures the data is retrieved quickly for any kind of analysis.
TABLEAUTableau is a data visualization tool that connects different sources and allows a rapid insight by transforming data into visual form of dashboards that are interactive, making it easier to understand. It has an excellent user experience. Tableau can handle large amount of data that can produce reports based on these large set of data without affecting the network performance. It helps to connect live data sources that show the real time results on key business metrics.