Backup data
If NEW_TABLE already exists then …
insert into new_table select * from old_table
/If you want to create NEW_TABLE based on the records in OLD_TABLE …
create table new_table as select * from old_table
/
useful sql
23
02
15
In ORACLE
SELECT REPLACE(REPLACE(YourColumn,CHAR(13),NULL),CHAR(10),NULL)
FROM YourTable
FOR ONE CHAR :
SELECT replace(YourColumn,CHAR(13),'')
FROM YourTable
OR
update YourTable
set YourColumn =replace(YourColumn,CHAR(13),'')
IN .NET
MyString.Replace("\r\n","")
or..
MyString.Replace("\r\n",@"\n")Potential Blacklist Special control chars 0-31 by Unicode must be handled
White list
[^a-zA-Zא-ת0-9._] -and punctuation chars by your choice
- this is a start of a regex pattern - [^] -everything that not in the pattern is not allowed.
also can do
[^\w\s\p{IsHebrew}\p{P}] - not taking accesnt chars like ~^ , not finished , but a start
better handled by StringBuilder with loop through chars than Regex
(more than 10 times better).just Whitelist of allowed chars and if in range
like this
if(c>=a && c<=z)...
sb.append(c)
else
sb.append(' '); //replacement char
Installing ElasticSearch for Windows
21
12
14
For usage of commands in cmd with ElasticSearch you should install curl.
Better put it in c:\ for convenience .
You should download ES from here and install it.
You can check it in chrome – http://localhost:9200/
or
run it in cmd c:\curl -X GET http://localhost:9200/
Run few commands to automatize the process and make it easier to work with :
1) running as a service on windows
c:\elasticsearch-{version}bin>service install
2)install plugins
You better get the basics
bin/plugin --install mobz/elasticsearch-head
bin/plugin --install lukas-vlcek/bigdesk
installing marvel will give you the tools that ES itself promotes
bin/plugin -i elasticsearch/marvel/latest
3)In VS2013 quick launch – type nuget – choose Package Manager
paste-
Install-Package NEST –Version 1.2.1
it will get you the .net api for elasticsearh. the version is optional . without it gets the latest version
Encrypt–Decrypt connectionString
25
11
14
public static void Encrypt(){
Configuration objConfiguration = null;
if(HttpContext.Current!=null) //if we are in web application of some sort
objConfiguration = WebConfigurationManager.OpenWebConfiguration (“~”);
else ///if not web
objConfiguration = ConfigurationManager.OpenExeConfiguration(ConfigurationUserLevel.None);
ConfigurationSection objSection = “connectionStrings”;
//if encrypted already don’t do it again
if(objSection!=null && !objSection.SectionInformation.IsProtected){
objSection.SectionInformation.ProtectionSection(string.Empty);
objSection.SectionInformation.ForseSave = true;
objConfiguration.Save(ConfigurationSaveMode.Full);
}
}
public static void Encrypt(){
Configuration objConfiguration = null;
if(HttpContext.Current!=null) //if we are in web application of some sort
objConfiguration = WebConfigurationManager.OpenWebConfiguration (“~”);
else ///if not web
objConfiguration = ConfigurationManager.OpenExeConfiguration(ConfigurationUserLevel.None);
ConfigurationSection objSection = “connectionStrings”;
//if encrypted then decrypt
if(objSection!=null && !objSection.SectionInformation.IsProtected){
objSection.SectionInformation.UnprotectSection();
//objConfiguration.Save(); – you can save the change but it will reset all the global data of your application in iis (relevant to comment it for web applications,can stay on in others)
}
}
Setting constant parameter in WebAPI
25
11
14
So the mission was to set static member for connectionString , so that we’ll get the string from web.config just once. On the way we did Encrypt and Decrypt of the connectionString.
So the trouble was that we couldn’t be sure that the static field is staying or going on the request- response model of WebApi.
The easy solution was to reuse the existing code to init HttpContext.Current.Application[“connectionString”] value if it’s null at the global.asax at Application_Start function.
When initialized in that function at the host/server side of the distributed system , the HttpContext.Current.Application[“connectionString”] is initialized for the first time and until the IISReset.
If you want something constant for one request the way to go is to put it in Init function at gobal.asax
The trouble was that the Application variable has been resetting itself each request.
The solution was that because of decryption that has been saving the web.config it has been resetting the site values held by the IIS, so actually it has been recycling the site data resetting the Application variables values also.
At the end the encryption has been executed on publish to the server, the decrypt has been decrypting the secured section but hasn’t been saving it back , so the web.config actually haven’t changed throughout running host , so the Application data kept intact.
So , after the last post about elasticsearch that explains a bit the terms of the technology , I’m getting to real life problems.
So after I’ve done entering the data into the elasticsearch at the last post I have now to delete it all! Oh my , how did that happened! What shell I do now ?
Well if you are only starting it’s not that bad , just delete the index , which will remove the data and existing mapping as well.
curl –XDELETE “http://localhost:9200/test”
WHY?
One of the demands was to make the data searchable by only few chars , and not the whole word.
So .. ?
Well actually that means that the default indexing that occurred while creating the index is not good enough , we should have defined the index settings manually suggesting from the beginning what kind of analysis should be performed on the index .
The nGram allows as to break the data that we enter to small tokens witch we can search later. So if you have
“Jerusalem”
and define nGram min- 7 , max – 20 ==> you”ll get indexed “[Jerusal, Jerusale, Jerusalem]”
Of course more logical is to start with two chars nGram min and go on..
Tried to set the indexing and mapping into one file but it failed with mistake
Analyzer [your_analyzer_name] not found for field [_all]
When I split it ,it worked.
To the last post I added the manual index definition : CreateIndex.js:
{
“index” : {
“name” : “test”,
“number_of_shrads”: 1,
“settings” : {
“analysis”:{
“filter”: {
“your_name_for_nGram_filter”:{
“type” : “nGram”,
“min_gram”:”2”,
“max_gram”:”20”,
“token_chars”: [ “letter”, “digit” , “punctuation”, “symbol”]
}
}
},
“analyzer”:{
“your_name_for_index_analyzer”: {
“type”:”custom”,
“tokenizer” : “whitespace” ,
“filter”: [“lowercase”, “asciifolding” , “your_name_for_nGram_filter”]
} ,
“your_name_for_search_analyzer”: {
“type”:”custom”,
“tokenizer” : “whitespace” ,
“filter”: [“lowercase”, “asciifolding” ]
}
}}}}}
Than you run the curl to enter it :
curl –XPUT “http://localhost:9200/test” –d @c:\pathto\CreateIndex.js
{“acknowledged”:true}
Now we have the index settings right with autocomplete suggestions starting with 2 letters.
Now we reenter the mapping and data from the last post , just add some features to the mapping ;
CreateMappings.js :
{
“mappings”:{
“name_of_your_object”:{
“_all”: {
“search_analyzer”:“your_name_for_search_analyzer” ,
“index_analyzer”:“your_name_for_index_analyzer” ,
},
“properties”:{
“field_you_don’t_wont_to_break_to_small_tokens”:{
“type”:”string”,
“index”:”not_analyzed”
},
“always_in_query_field” :{
“type”:”string”,
“include_in_all”:true
}
}}}}
Than you run the curl
curl –XPUT “http://localhost:9200/test/name_of_your_object/_mapping” –d @C:\pathto\createMappings.js
{“acknowledged”:true}
Now we’ll enter the actual data as at the last post
curl –XPOST “http://localhost:9200/test/name_of_your_object/_bulk –data-binary @c:\pathto\formatizedToIndex.json
Now you have data with analyzers inside the elasticsearch with autocomplete .. Happy searching!
Yield & readonly
11
06
14
Yield interacts with the foreach-loop. It is a contextual keyword: yield is a keyword only in certain statements. It allows each iteration in a foreach-loop be generated only when needed. In this way it can improve performance.
The nice things about using yield return is that it’s a very quick way of implementing the iterator pattern, so things are evaluated lazly.
Iterator pattern provides a way to traverse (iterate) over a collection of items without detailing the underlying structure of the collection.
readonly The readonly keyword is a modifier that you can use on fields. When a field declaration includes a readonly modifier, assignments to the fields introduced by the declaration can only occur as part of the declaration or in a constructor in the same class.
If you use a const in dll A and dll B references that const, the value of that const will be compiled into dll B. If you redeploy dll A with a new value for that const, dll B will still be using the original value.
If you use a readonly in dll A and dll B references that readonly, that readonly will always be looked up at runtime. This means if you redeploy dll A with a new value for that readonly, dll B will use that new value.
