programmering/klog på sas netværk...• excel til sas • eksempler på import, ods, xlxs libname...

Programmering/Klog på SAS Netværk4/3-2020 - Aarhus

• Velkomst

• Nyheder i SAS • v. Frans Holm, SAS

• Fordele ved de forskellige editorer (display manager, EG, SAS Studio)• v. Barbara Olsen, SAS

• Vlatin1/9 vs. UTF8• Kodeeksempler på hvad det kan betyde for dit output

• v. Barbara Olsen, SAS

• Secure - hvad betyder det for din kode (sftp, https)• v. Sara Armandi, SAS

• Excel til SAS• Eksempler på Import, ODS, xlxs libname

• v. Sara Armandi, SAS

• Afslutning

• Frokost

• Hvordan koder man i Viya – lidt teori og eksempler? • v. Frans Holm, SAS

Dagsorden

Hvorfor FANS?

• Netværk

• Vidensdeling

• Vise Nyheder

• Vise muligheder

• ”Best” Practice

• Inspiration

• Øge værdien & anvendelsen af SAS (ROI – ROY)

• Hyggeligt/sjovt/spændende

LodtrækningVind en sas-ting

Nyheder i SASFrans Holm (SAS)

Nyt fra SAS

• EG kursus - What's New

• 3 timer in-house eller on-site

• Ny e-bog : https://support.sas.com/en/books/free-books.html

• sas.com/fans-dk

• Folkemødet

• What’s new in SAS 9.4 M6…

• AD synkronisering – Microsoft opdatering

• SAS dag – hos jer

Fordele ved de forskellige editorer (display manager, EG, SAS Studio)

Barbara Olsen (SAS)

Agenda

• Editors:

o SAS Studio

o Notepad++(+)

o https://blogs.sas.com/content/sasdummy/2017/08/25/npp-with-sas/

PAUSEVi begynder igen kl. 10:15

Vlatin1/9 vs. UTF8Barbara Olsen (SAS)

Agenda

• Encoding – hvor støder man på det?

• DBCS (DoubleByteCharacterSystem) (MBCS (MultiByteCharacterSystem)) vs SBCS (SingleByteCharacterSystem)

Encoding – hvor støder man på det?

DBCS (MBCS) vs SBCS

DBCS(MBCS) vs SBCS

Windows std. Wlatin-1 /Windows-1252

UnixLatin1

Unix (sas install standard)Latin9

Et par eksemplerTekst filer

• Session WLatin1 • Session UTF-8data navne;

Infile "<TextFileANSI.txt>";

length Navn $20;

input navn $;

LNavn = length(navn);

data navne;

infile "<TextFileUTF8.txt>";

length Navn $20;

input navn $;

data navne;

length Navn $20;

input navn $;

data navne;

length Navn $20;

input navn $;

INFILE WLatin1.sas

Et par eksemplerTekst filer - Fixed

length Navn $20;

input navn $;

data navne;

length Navn $20;

input navn $;

data navne;

infile "<TextFileANSI.txt>"

encoding='wlatin1';

length Navn $20;

input navn $;

KLNavn = Klength(navn);

data navne;

length Navn $20;

input navn $;

KLNavn = Klength(navn);

INFILE UTF-8.sas

Et par eksemplerSAS Data

set fans.navne_wlatin;

KLNavn = KLength(navn);

data navne;

set fans.navne_utf8;

data navne;

set fans.navne_wlatin;

data navne;

set fans.navne_utf8;

SET WLatin1.sas

Et par eksemplerSAS Data – pas på længder

• Session WLatin1 • Session UTF-8data frugt;

set fans.frugt_L1;

data frugt;

set fans.frugt_u8;

data frugt;

set fans.frugt_L1;

data frugt;

set fans.frugt_u8;

SET2 WLatin1.sas

Et par eksemplerSAS Data – pas på længder – måske løsning

• Session WLatin1 • Session UTF-8data frugt;

set fans.frugt_L1;

data frugt;

set fans.frugt_u8;

/* CVP: Character Variable Padding */

/* Default CVPMULTIPLIER = 1,5 */

libname t cvp '<path>';

data frugt;

set t.frugt_L1;

data frugt;

set fans.frugt_u8;

SET2 UTF-8.sas

DBCS(MBCS) vs SBCS

PAUSEVi begynder igen kl. 11:20

Secure - hvad betyder det for din kode(sftp, https)Sara Armandi (SAS)

– Hvad betyder det for din kode (SFTP, HTTPS)

Sara Armandi

SecureSara Armandi

HTTPSFTP

Encryption

Authorization

HTTP Procedure: Using HTTPS

• In SAS 9.4M3, the FTP access method also supports Secure FTP (FTPS). FTPS includes full support for the Transport Layer Security (TLS) and Secure Socket Layer (SSL) cryptographic protocols, including the use of server-side public key authentication certificates and client-side authorization certificates.

• https://go.documentation.sas.com/?docsetId=lestmtsglobal&docsetTarget=p0v0ijxl1k6d4bn16cshtic7u4i3.htm&docsetVersion=9.4&locale=en#n0ypyegm0s59vln1wc9ghi3krygu

• Details

FILENAME Statement: FTP vs FTPS

• For both SAS 9.4 (beginning with SAS 9.4M3) and the full SAS Viya deployment, secure communication over HTTP (HTTPS) is provided globally by default.

• https://go.documentation.sas.com/?docsetId=proc&docsetTarget=p19qqqyq9te9u3n1oq8fbdta7dqt.htm&docsetVersion=9.4&locale=en

More Info

• https://blogs.sas.com/content/sgf/2013/11/20/how-to-use-encryption-in-base-sas-9-4/

• https://www.youtube.com/watch?v=EDvARXCu3VQ

Excel til SASEksempler på Import, ODS, xlxs libname

Sara Armandi (SAS)

Agenda

• Import

• Peg-klik

• Kode

• Libname Engine

• Export

• Peg-klik

• Kode

• Libname Engine

• Rapporter ODS

Importer Excel – Enterprise GuidePeg-Klik

• File -> Import Data:

Importer Excel – Enterprise GuideKode

• PROC IMPORT

• Datafile=

• Out=

• DBMS=

• REPLACE

• GETNAMES=YES

Importer Excel – Enterprise GuideLibname Engine

• LIBNAME Engine:

• EXCEL

• XLSX

Exporter til Excel – Enterprise GuidePeg-Klik

• Export Data:

Exporter til Excel – Enterprise GuideKode

• PROC EXPORT

• Data=

• Outfile=

• DBMS=

• LABEL

• REPLACE

Exporter til Excel – Enterprise GuideLibname Engine

• LIBNAME Engine:

• EXCEL

• XLSX

Exporter til Excel – Enterprise GuideODS

• ODS EXCEL

• FILE=

• OPTIONS(

- Froozen_headers

- Sheet_name

- Autofilter

- …….

• Excel formatering

• Excel formler

AfslutningFrans Holm (SAS)

Netværksmødersas.com/fans -> Network Meetings

- 4/3 Programmerings netværk – Aarhus

- 12/3 Visual Analytics netværk - København

- 13/3 Visual Analytics netværk – Aarhus

- 25/3 Webinar - SAS Data preparation & SAS studio Features and Functions

- 29/3 SAS Global Forum – Washington DC

- 23/4 Sådan anvender vi SAS – Aarhus

- 29/4 Webinar - Walkthrough of the Local SAS Forum programs. 2 divided tracks FI/SE

- 13/5 Webinar - Walkthrough of the Local SAS Forum programs. 2 divided tracks DK/NO

- 27/5 SAS Forum - København

- 17/6 Webinar - Version Control

Hvordan anvender jeg SAS?5 min. oplæg…

SAS Global Forum 2020

• Events

• Welcome reception – Sunday afternoon

• Nordic dinner – Monday evening

• Knowledge Sharing

• Lunch – knowledge sharing

• Meeting with R&D

• Meet Ron Agresta – Director R&D Data Management

• Sightseeing

• Sunday: Arlington & National Mall

• Running: Saturday and Monday morning

Nordic Add-ons

• Support• https://support.sas.com

• Dokumentation• https://support.sas.com/en/documentation.html

• Youtube• https://www.youtube.com/user/SASsoftware

• https://www.youtube.com/sasusers (NYHED)

• Webinar – Nordisk vs. Globale• https://www.sas.com/sas/events/nordic/nordic-webinars.html

• https://www.sas.com/da_dk/webinars.html

• https://www.sas.com/en_us/learn/ask-the-expert-webinars.html

• Proceedings Global forum• https://www.sas.com/en_us/events/sas-global-forum/program/proceedings.html

• https://www.lexjansen.com/cgi-bin/xsl_transform.php?x=sgf2018

• SAS Nyhedsbreve• https://www.sas.com/da_dk/news/e-newsletters.html

• FANS• sas.com/fans

• https://www.sas.com/sas/events/nordic/fans-nordic-sas-user-group.html#

• LinkedIN• https://www.linkedin.com/learning/topics/sas

• Uddannelse• https://www.sas.com/da_dk/training/overview.html

Hvor kan du finde viden om

SAS software?

LodtrækningVind en sas-ting

sas.com

Tak for i dagvi ses fans

Husk evaluering

Hvordan koder man i Viya?Frans Holm (SAS)

• SAS beregningsmotorer/runtime environments

• 4 Rules to Understand CAS Management of In-Memory Data

• Lidt teori om CAS/CASLIB

• Programmering i CAS

• CAS

• CASLIB

• Proc CASUTIL

Arkitektur overblik

Application Services (Microservices)

Runtime Environments

APIs /UIs

MVA CAS ESP In-DB

Data Access

Security, Governance, Administration

Host Environments

Products / SolutionsPython

RJavaLua

REST APIs

SAS codeSAS interfaces

Streaming

Hadoop

Database

Customer IntelligenceRisk

Fraud & Security

AnalyticsVisualization

Data Management

On-Premises, Private, Public, Hybrid Cloud

SAS Viya

Servers

Programming run-time

Services

Infrastructure Servers

Analytic Engines

Microservices

Web Applications

SAS Cache Locator

SAS Cache Server

SAS Configuration Server

Apache HTTP Server

SAS Infrastructure Data Server

SAS Message Broker

SAS Secret Manager

SAS Workspace

Server and SAS

Object Spawner

SAS/CONNECT

Server & Spawner

Embedded Web

Application Server

SAS Launcher

Server

SAS Compute

Server

ElasticSearch

Components & Services

Analytic Engines

The Analytic Engines:

• CAS: Cloud Analytic Services

• SPRE: SAS Programming Runtime Environment

• ESP: Event Stream Processing

• MAS: Micro Analytic Scoring

• Elastic Search: OpenSource search and indexing

Analytic Engines

ElasticSearch

SAS Launcher Server and Service

• The SAS Launcher Server is used to start processes in a SAS Viya environment - just as the SAS Object Spawner is used to start processes in SAS 9

• The SAS Launcher Service is a SAS Viya microservice that exposes a REST interface to - start processes using a launcher server

- define launcher contexts

SAS Compute Server and Service

• The SAS Compute Server is a back-end server process that provides access to SAS Foundation in a SAS Viya environment - just as a Workspace Server does with SAS 9

• The SAS Compute Service is a SAS Viya microservice that exposes a REST interface to - talk to a compute server

- define compute contexts

4 Rules to Understand CAS Management of In-Memory Data

• № 1. CAS analyzes data in SASHDAT format, regardless of the original source

• № 2. All in-memory data is memory mapped to a locally-accessible backing store

• № 3. The OS, not CAS, moves data to/from the backing store

• № 4. CAS_DISK_CACHE is where all replicated copies of data are stored

CAS/CASLIB

REST OF THE DISK

OS SWAP

Memory & CAS

• When CAS writes to memory, it actually writes to “buffer cache*” as opposed to writing to a dedicated memory space

• CAS data in memory is not static, data moves from disk in and out of memory as required

• This means CAS:

• Will never run out of memory

• Won't waste memory

• Could thrash if memory is tight

• Always has to have the data on "local" disk for reloading data blocks that are no longer in memory

CAS Disk CacheOr SASHDAT

RAM (buffer cache)

RAM (dedicated)Physical memory

*buffer cache=file cache=page cache

CAS_DISK_CACHEDefault Use

• CAS_DISK_CACHE:

• Acts a part of CAS’ total memory space for working with data

• Enables flexibility to work with data over time as well as failure resilience

• Is used (or not) depending on many factors including: data provider, data format, encryption, programming directives, etc.

• Rule of thumb:

• If the original source is unencrypted SASHDAT which can be m-mapped by the Workers on locally accessible disk, then CAS_DISK_CACHE is not used as an in-memory backing store for that data load.

Data MovementSerial transfer with data from a SAS runtime CAS client

CONTROLLER WORKER WORKER WORKER

cas1.site.com cas2.site.com cas3.site.com cas4.site.comviya1.site.com

Infrastructure services

SAS Viya

CAS_DISK_CACHE

In memory (RAM)

A TableB C

Communication

Data transfer

In memory tables

CASLIB

Programmering i Viya

• Intet nyt – du kan det samme

• Datastep & Proc’s

• Og alligevel …

• Regler:

• Data skal være i CAS for at kunne bruge CAS

• Ikke alt gøres på samme måde i CAS

• CAS

• CASLIB

• Proc CASUTIL

• List

• Load

• Save

• Deletesource

• Contents

• Se: ”Viya_kode_eksempler.sas”

Spørgsmål?????

• Hvorfor bliver et CASlib ikke allokeret til et Libname?

• Hvilke filer er på disk under CASUSER?

• Gemmer LOAD filerne?

• Loader SAVE tabellen i memory?

• Hvilke datasæt er tilgængelige på CASUSER in-memory?

• efter start af ny session?

• Hvilke datasæt kan jeg se i Visual Analytics?

• Hvor mange rækker er der i outputtet?

• Hvordan er outputtet sorteret?

Viya tegning

ComputeServer

Visual Analytics

SASStudio

CAS_DISK_CACHECAS CAS_DISK_CACHECAS CAS_DISK_CACHE

• https://support.sas.com//en/software/sas-viya.html

• https://go.documentation.sas.com/?cdcId=pgmsascdc&cdcVersion=9.4_3.5&docsetId=pgmsashome&docsetTarget=home.htm&locale=en

• https://communities.sas.com/t5/SAS-Communities-Library/CAS-data-distribution-DUPLICATE-a-REPLICATION-using-COPIES-Can/ta-p/368796

programmering/klog på sas netværk...• excel til sas • eksempler på import, ods, xlxs libname...

Documents

update from sas - analytics, business intelligence and ......

base sas 2 sas windowing environment

sas und r - · pdf fileschnittstelle sas iml 9.22 zu r 20...

sas real-time decision manager · sas real-time decision...

bliv klog på bliv klog på bæredygtighed og mad ·...

inlsuitend sas/uitsluitend sas

« i thailand er jeg klog, men i danmark er jeg lidt dum »

hsw 66+ &klog 'hyhorsphqw · 2019. 4. 11. · 7kh...

introduÇÃo ao sas -...

informÁtor xxi/2010/2 - savinformátor sas xxi/2010/2...

sas 500/600 ults - tieftemperaturstahl (-165°c)...sas 500 /...

learn sas 2019 · 2019-05-17 · sas certified advanced...

initiationaulogiciel sas(9)...

bliv klog på bæredygtighed i byggebranchen -...

sas 9.4 - polonizacja, polonizacja sas

orchestra- · pdf filesaturne sas le trefle sas theo et...

cinema - astebolaffi.it · sport & cinema memorabilia...

独立行政法人国立病院機構...

getting started with sas base and sas enterprise · pdf...

sas® foundation installation sous...