Elastic Search

           Many times we have seen clips of a kid / adult standing in a room and all sort of numbers , characters, equations revolving around him!!!! 

          Some may see it as a millions of thoughts and numbers going through the mind of the person and being able to understand all that or something “out of world” is going to happen..

  

For me .. being into the technology is just data  

Have we ever wonder with the advent of this inventions in technology world there is so much of data that is floating around that is being used for a variety of purposes?  Every time you tap your finger on a keyboard of any size/shape/material you are unleashing data.  

From out of this world say Mars to a trivial thing like booking an Uber to work. 

So, how do I search this data, so that I be optimally used for the benefit of every one.  That’s where elastic search comes into play.   ElasticSearch is spreading it’s wings very very fast .. and I am amazed with the ease with which it functions. 

So, what is Elastic Search 

It’s a opensource software that makes massive amounts of structured and unstructured data available for search, logging, analytics and more in mission critical systems and applications. 

ElasticSearch is based on LUCENE. LUCENE is an information retrieval software library. 

Before I dive into Elastic search , let me give you a few use case of how different corporates from different businesses use Elastic Search.  

So, let me start from the Mars 

NASA : uses the ELK stack (ElasticSearch, LogStash , Kibana)  

Nasa says the uses the ELK stack to log more than 30K messages and 100k 4 times everyday from Mars ROVER to optimize our space missions 

The Guardian uses it for marketing Insights , Business Development and to capture customer sentiments. 

Goldman Sachs/ Verizon use it for IT Operations, Application Management. Verizon’s Elastic Search works for over 500 million documents.

Facebook uses it for variety of things along with ElasticSearch’s Security Plugin. 

Ebay/ Github uses it for Website Search / Internal and Intranet Search and url searchs. Github everyone know .. every line of code that your search uses Elastic Search.  

Wikimedia – Full text searches are powered by Elastic Search

UBER – Information about your ride every 4 seconds is sent to Elastic search. This is used for get your details, drivers detail and used so that they can serve you better. 

 

 

 

I was exposed to Elastic Search when Oracle PeopleSoft started using it for searches with PeopleSoft Applications. As a PeopleSoft Administrator, Elastic Search lifted off from the me the burden of maintaining SES search.  Elastic Search is fast to install and so easy to implement and almost zero maintenance. 

 

PeopleSoft Search Framework integrates with Elasticsearch to allow for high availability, failover, and scalable search deployments for PeopleSoft users 

 

The searches implemented in SES can be easily built in ElasticSearch, just Undeploy  - Re-Deploy and Rebuilt. 

 

Taking control fo the logs can also be done with ElasticSearch 

 

 

Advantage of moving to Elastic Search 

• Better crawl and search capabilities and performance 
• Better resource utilization 
• Easy to install and maintain 

More to come...

Configuring Elastic Search PeopleSoft

Installation of Elastic Search

Open Command Prompt in administrator mode.

Make directory d:\apps\elastic

Download zip file ELASTICSEARCH-DPK-WIN-2.3.2_03.zip to d:\apps\elastic\ from MOS

Downloading Using getMOSPatch.jar :
  Download getMOSPatch-master.zip from github website.
  Unzip getMOSPatch-master.zip

From command prompt cd to d:\apps\elastic

echo %JAVA_HOME% -- If java is not installed , download and installed.

d:\apps\elastic>java -jar d:\apps\elastic\getMOSPatch-master\getMOSpatch.jar PATCH=26172221 PLATFORM=233P download=all
Provide your MOS userid and password

ELASTICSEARCH-DPK-WIN-2.3.2_03.zip will be download.

Unzip ELASTICSEARCH-DPK-WIN-2.3.2_03.zip and change directory to d:\apps\elastic\setup

run the following command to install Elastic Search.
psft-dpk-setup.bat --install --install_base_dir "d:\apps\esearch"

You will be prompted to provide password for following users
esadmin, people

You will be prompted to provide ES Clustername, HTTP Port (default is 9200)
Discoveryhost - leave it as default

You should get a installation complete message.

Setting up Elastic Search in People Application

Integration Gateway has to be configured.
Check Domain status (Peopletools->Integration Broker -> Service Operations Monitor->Administration
Configure Nodes all the local nodes
Peopletools -> Integration Broker-> Integration Setup-> Nodes
  Open Local Nodes(PSFT_HR,HRMS) -> Portal tab ->
  change
  Content Uri Text http://server:port/psc/sitename/
  Portal URI text.  http://server:port/psp/sitename/

  Open Node-Anonymous and change the user that has Search Roles and Permission
       Changed it to PS
     
   PeopleTools -> Search Framework->Administration->Search Instance
    Add a new instance
    Search Instance :ELASTIC
    Search Provided :Elasticsearch
 
    Properties
     Hostname:server on which ES is installed.
     Port : Default port 9200 (can be changed)
     ssl option (disabled)
     Username : esadmin / give password
     Proxy Name : people / give password
   
   
   Call Back Properties
     Url: Peoplesoft PIA url using REST Listening Connector.
         http://     User, Password
   
     Verfiy by clicking on Ping,test login, proxy login, Validate.

Error: UserName not defined in database  ( errorLog.html)

Give appropriate user in Anonymous node (Like PS)

   
   

Super Cool Windows 10 Features ..

HI Guys

Been a while since I have penned ..

I have been using Windows 10 for while now .. and it about time that I must admit..There are many many cool features that can make your life a lot easier..

I am going to try and put in 1 feature every day ( some features come from earlier versions as well)

Today's Feature

1. GodMode:

Right Click on your Desktop -> create a new folder ->  and name it

GodMode.{ED7BA470-8E54-465E-825C-99712043E01C}

The icon will change to

Just Double Click ..enjoy the surprise...Extremely handy on personal laptops where You are the "BOSS"

2. Steps Recorder

Click on windows button , type in Steps Recorder you will get

Start Recording.

When  you stop, it will generate .zip file containing .mht file.

This file can be shared with anyone and opens in browsers.

3. "Where "

This is a windows command to search for the path of a file.

C:\>where system.ini

C:\Windows\system.ini

Restriction , it does search a folder , and the directories in the PATH variable will only be searched.

for recursive search

where /R

where /R c:\ hosts
where /R d:\images abc*.jpg

4. Minimizing Open Windows except the one you are working on

Left Click on the header (blue) bar and keeping it pressed just give it a shake and u will see all the other windows minimizing.
Do the same again and they will all open again.

5. Windows TrackPad (Mouse Pad /Touch Pad on your laptop ) Features

• Tap one finger on the touchpad: Select an item (same as left-clicking a mouse).
• Tap two fingers on the touchpad: Show more commands (same as right-clicking a mouse).
• Swipe up or down with two fingers: Scroll a page up or down.
• Pinch or stretch out two fingers: Zoom in or zoom out (magnify or shrink).
• Swipe up with three fingers: Show all recent activity and open windows via Windows Timeline.
• Swipe down with three fingers: Minimize everything and show the desktop.
• Swipe left or right with three fingers : Switch between all windows that are currently open (same as Alt+Tab).
• Tap three fingers on the touchpad: Open Cortana/search.
• Tap four fingers on the touchpad: Open Action Center.
• Swipe left or right with four fingers: Switch between all virtual desktops.

6. Cloud Clipboard

We all are used to pasting what was last copied , but how would it be if you were to see last 7 to 8 thing that you copied using Ctrl+C..... 

Here's what you need to do 

Click on Windows -> Settings -> System and scroll down to Clipboard and turn on History option on the right hand pane and you are all set.

Use Window key + V (instead of Ctrl V) to see history choose and paste.

Amazon Web services...a walk through the cloud

I am amazed by the wide spectrum of services that Amazon Web Services provides. 

Need to deep dive into this VIRTUAL MALL of resources that I feel can suit outfits/corporate of any size financially or strength wise. Corporate World is going to be surprised with the money saved and the value for that money they have invested in cloud. 

Today I am going to talk about various Services provided by AWS.

NETWORK AND CONTENT DELIVERY

VIRTUAL PRIVATE CLOUD i.e  VPC is A virtual private cloud (VPC) is a virtual network that closely resembles a traditional network that you'd operate in your own data center, with the benefits of using the scalable infrastructure of Amazon Web Services (AWS).

ROUTE 53 is Amazon DNS Services for

Register domain names
Route Internet traffic to the resources for your domain 
Check the health of your resources 

CLOUDFRONT Accelerates the delivery of websites,videos,API's

DIRECT CONNECT  Connection between ON Premise and AWS CLOUD is achieved using Direct Connect.

COMPUTE

Amazon Elastic Compute Cloud (Amazon EC2) is a web service that provides resizable compute capacity in the cloud. In simple words it gives us the ability to create virtual machines of different configurations

Amazon EC2 Container Service (ECS) is a highly scalable, high performance container management service that supports Docker containers and allows you to easily run applications on a managed cluster of Amazon EC2 instances

AWS Elastic Beanstalk is an easy-to-use service for deploying and scaling web applications and services developed with Java, .NET, PHP etc
You can simply upload your code and Elastic Beanstalk automatically handles the deployment, from capacity provisioning, load balancing, auto-scaling to application health monitoring.

AWS Lambda lets you run code without provisioning or managing servers

STORAGE

Amazon Simple Storage Service (Amazon S3) is object storage with a simple web service interface to store and retrieve any amount of data from anywhere on the web. One can look at it as virtual disks in the cloud to store various objects like files, videos, photographs etc

Amazon Glacier is a secure, durable, and extremely low-cost cloud storage service for data archiving and long-term backup. Data that needs to be maintained for legal purposes etc can be stored in Glacier. Retrieval can take 4-5 hours.

AMAZON EFS is Elastic File System to me is similar to NFS but it in the cloud. It is a block based storage that can be shared between multiple Virtual machines.

STORAGE GATEWAY is used to connect S3 to on premise data centers.

Amazon Elastic Block Store (Amazon EBS) provides persistent block storage volumes for use with Amazon EC2 instances in the AWS Cloud



...to be contd