Updates from julie Toggle Comment Threads | Keyboard Shortcuts

  • julie 12:50 pm on July 8, 2015 Permalink
    Tags: ,   

    MySQL TIPS 

    for pew:

    • sudo mysql (to give permissions)
    • create database ; (only needs setting up once)
    • use ; (before you start working on a db, make sure you are using the right one)
    • create table
      …etc see below.
    • show tables;
    • describe
      ;

    DB: nmr
    TABLE: datatest

    • CREATE TABLE datatest (time TIMESTAMP, recID TINYINT(10), avidID VARCHAR(16));

    Check status (on pew, RHEL)
    > mysqladmin -u root -p status

    Start Mariadb (on pew, RHEL)
    > sudo systemctl start mariadb

    Deleting rows
    > delete from nmr_records where id = >”799″;

    > delete from nmr_index where colony = “800”;

    Add columns:
    > alter table nmr_records add column worker_pc smallint(4);

     
  • julie 10:30 am on July 8, 2015 Permalink  

    Tools and resources for learning data analysis, visualization, social media 

    list of BEST tools and resources for learning data analysis, visualization, and working with social media data – Google Docs.

    from Lev Manovich

     
  • julie 4:52 pm on July 7, 2015 Permalink
    Tags: command line,   

    Terminal TIPS (linux) 

    This is a mix of Mac command line, RHEL, and Raspian commands — not all work on all platforms.

    $ sudo find / -name XXX [Find things]

    $ sudo -i [elevate your self to super user]

    $ cd / [change to root directory]

    $ cd ~ [change to home directory]

    $ ls -a [list everything folder AND files]

    $ cat > filename.txt [use this to make a text, or any, file, Ctrl D to save and exit text edit]

    $ cat filename.txt [use this to read the file]

    $ cat /etc/redhat-release [to get OS version of RedHat]

    $ hostnamectl [will return hostname, machine ID, kernel and OS info]

    $ ip addr show | grep inet [will show ip details, not sure why one below is diff]

    $ curl -s checkip.dyndns.org | sed -e ‘s/.*

    Current IP Address:

    $ df –show you used and available space on the harddisk

    $ shutdown -h now =shutdown now
    $ shutdown -h +10 =shutdown in 10 mins

    $ rm -i filename.txt = remove file but get confirmation request before it goes

    $ rm -r example = removes directory (name: example) and all files and subdirs in it

    $ cp -p file1 file2 =copy file keeping mode, ownership and timestamp

    $ cp -i file1 file2 =copy file1 to file2 i If file2 exists get confirmation before overwriting

    $ mv -i file1 file2 =rename file1 to file2 (+ get confirmation if file2 exists)

    1. mkdir /u01 = mount a file system, by first creating a directory and mount it as below.
    1. mount /dev/sdb1 /u01

    $ locate filename =locate a file

    $ tail -f /var/log/syslog [will show you live log activity] on Pi anyway *******THIS

    More useful tips: http://www.thegeekstuff.com/2010/11/50-linux-commands/
    Also: http://www.tecmint.com/51-useful-lesser-known-commands-for-linux-users/

    Generate key:
    $ ssh-keygen -t rsa

    Copy public key to clipboard:

    $ pbcopy < ~/.ssh/id_rsa.pub

    help brings up the OS version:

    GNU bash, version 4.2.46(1)-release (x86_64-redhat-linux-gnu)

    File Permissions:

    • 777 (rwxrwxrwx) No restrictions on permissions. Anybody may do anything. Generally not a desirable setting.
    • 755 (rwxr-xr-x) The file’s owner may read, write, and execute the file. All others may read and execute the file. This setting is common for programs that are used by all users.
    • 700 (rwx——) The file’s owner may read, write, and execute the file. Nobody else has any rights. This setting is useful for programs that only the owner may use and must be kept private from others.
    • 666 (rw-rw-rw-) All users may read and write the file.
    • 644 (rw-r–r–) The owner may read and write a file, while all others may only read the file. A common setting for data files that everybody may read, but only the owner may change.
    • 600 (rw——-) The owner may read and write a file. All others have no rights. A common setting for data files that the owner wants to keep private.

    Directory Permissions:

    • 777 (rwxrwxrwx) No restrictions on permissions. Anybody may list files, create new files in the directory and delete files in the directory. Generally not a good setting.
    • 755 (rwxr-xr-x) The directory owner has full access. All others may list the directory, but cannot create files nor delete them. This setting is common for directories that you wish to share with other users.
    • 700 (rwx——) The directory owner has full access. Nobody else has any rights. This setting is useful for directories that only the owner may use and must be kept private from others.

    install phpmyadmin

    sudo yum install http://pkgs.repoforge.org/rpmforge-release/rpmforge-release-0.5.3-1.el7.rf.x86_64.rpm
    sudo yum install phpmyadmin
    edit conf files to enable remote access (might have to fiddle with path name):
    sudo nano /etc/httpd/conf.d/phpMyAdmin.conf

    src: http://www.tecmint.com/install-lamp-in-centos-7/

     
  • julie 1:12 pm on July 7, 2015 Permalink  

    DataCite 

    We want to help make data more accessible and more useful; our purpose is to develop and support methods to locate, identify and cite data and other research objects. Specifically, we develop and support the standards behind persistent identifiers for data, and our members assign them.

    via What do we do? | DataCite.

     
  • julie 10:44 am on July 7, 2015 Permalink
    Tags: ,   

    re3data – schema 

    Schema for the Description of Research Data Repositories

    Version 2.2 December 2014

    doi: http://doi.org/10.2312/re3.006

    http://gfzpublic.gfz-potsdam.de/pubman/item/escidoc:758898:3/component/escidoc:775891/re3data_schema_v2-2_public_final-2014-12-03.pdf

    Research data are valuable and ubiquitous. The permanent access to research data is a challenge for all stakeholders in the scientific community. The long-term preservation and the principle of open access to research data offer broad opportunities for the scientific community. More and more universities and research centres are starting to build research data repositories allowing permanent access to data sets in a trustworthy environment. Due to disciplinary requirements, the landscape of data repositories is very heterogeneous. Thus it is difficult for researchers, funding bodies, publishers and scholarly institutions to select appropriate repositories for storage and search of research data. re3data.org is a global registry of research data repositories that covers research data repositories from different academic disciplines. It presents repositories for the permanent storage and access of data sets to researchers, funding bodies, publishers and scholarly institutions. re3data.org promotes a culture of sharing, increased access and better visibility of research data. The registry is funded by the German Research Foundation (DFG)1 and went online in autumn 2012.

     
  • julie 3:46 pm on July 6, 2015 Permalink
    Tags: nemacode,   

    Naming:
    Nemacode – serverside
    Critter – data vis / public facing

    Today:
    upgrade node-red to 0.10.10
    start Python build, set up GIT on Pi

     
  • julie 2:29 pm on July 6, 2015 Permalink
    Tags:   

    Soft Robotics – journal 

    Soft Robotics.

     
  • julie 2:27 pm on July 6, 2015 Permalink  

    Seeing Data – research project 

    Seeing Data.

    Seeing Data is a research project which aims to understand how people make sense of data visualisations like the examples below. This website explains what we have been doing on Seeing Data, what we have found out, and how non-experts can develop their ability to make sense of data visualisations.

    The ‘Understanding Data Visualisations‘ section of the website is a resource which aims to help people make sense of data visualisations. It’s for the general public – people who are interested in visualisations, but are not experts in this subject.

    The ‘About Seeing Data Research’ section is about the research that we have carried out, how we went about it, and what we found out.

     
  • julie 4:56 pm on July 1, 2015 Permalink  

    malevich-suprematism+colour text

     
  • julie 1:21 pm on July 1, 2015 Permalink  

    100 open source Big Data architecture papers for data professionals. | Anil Madan | LinkedIn.

     
  • julie 11:51 am on July 1, 2015 Permalink
    Tags: Kasper Althoefer, , , silicon,   

    KasperAlthoefer_softrobot_water_setup

    KasperAlthoefer_softrobot_water

     
  • julie 12:17 pm on June 30, 2015 Permalink
    Tags: ,   

    ralf baecker – portfolio 

    ralf baecker.

    physical constructions – review for data usage etc…

     
  • julie 12:11 pm on June 30, 2015 Permalink
    Tags: ,   

    Ian Ingram | Animal Machines 

    Ian Ingram | Machines.

    Really relevant work for the NMR project intro.

    Go through further and explore use of data, anthropomorphisation, kinetic motion

     
  • julie 11:28 am on June 30, 2015 Permalink  

    art and sci in the post-biological age 

    http://videodoc.ncca-kaliningrad.ru/participants/iv-body-as-technology/

    good repository for artworks (inc The Lake)

     
  • julie 9:30 pm on June 25, 2015 Permalink
    Tags: , antoinette rouvray   

    Society of the Query | Algorithmic governmentality and the end(s) of critique–Antoinette Rouvroy.

    Quote: “knowledge is not produced about the world anymore, but form the world[..]” (i haven’t found quote yet – this was at Intrefaces seminar slides by Christian Ulrik Anderson.

     
  • julie 1:18 pm on June 23, 2015 Permalink
    Tags:   

    Milestones in the History of Thematic Cartography, Statistical Graphics, and Data Visualization 

    Milestones in the History of Thematic Cartography, Statistical Graphics, and Data Visualization.

     
  • julie 5:51 pm on June 21, 2015 Permalink
    Tags:   

    List of Physical Visualizations 

    Active physical visualization | List of Physical Visualizations.

     
  • julie 10:26 am on June 17, 2015 Permalink
    Tags: , object   

    Noumenon 

    The noumenon (/ˈnɒuːmɨnɒn/) is a posited object or event that is known (if at all) without the use of the senses.[1] The term is generally used in contrast with, or in relation to “phenomenon”, which refers to anything that appears to, or is an object of, the senses. In Platonic philosophy, the noumenal realm was equated with the world of ideas known to the philosophical mind, in contrast to the phenomenal realm, which was equated with the world of sensory reality, known to the uneducated mind.[2] Much of modern philosophy has generally been skeptical of the possibility of knowledge independent of the senses, and Immanuel Kant gave this point of view its canonical expression: that the noumenal world may exist, but it is completely unknowable to humans. In Kantian philosophy, the unknowable noumenon is often linked to the unknowable “thing-in-itself” (Ding an sich, which could also be rendered as “thing-as-such” or “thing per se”), although how to characterize the nature of the relationship is a question yet open to some controversy.

    via Noumenon – Wikipedia, the free encyclopedia.

     
  • julie 10:49 am on June 16, 2015 Permalink  

    ACM Computing Classification System, 2012 Revision 

    http://delivery.acm.org/10.1145/2380000/2371137/ACMCCSTaxonomy.html?ip=138.37.32.43&id=2371137&acc=OPEN&key=BF07A2EE685417C5%2E53A024A4F41048F4%2E4D4702B0C3E38B35%2E6D218144511F3437&CFID=683826054&CFTOKEN=51013308&__acm__=1434451434_4215bafbd152f8c206a318a68f6020fd

     
  • julie 10:25 am on June 15, 2015 Permalink
    Tags: QMUL,   

    PhD Graduates & Theses | Centre for Digital Music (C4DM) | Queen Mary, University of London.

     
  • julie 1:36 pm on June 11, 2015 Permalink
    Tags: ,   

    Choosing R or Python for data analysis? An infographic.

     
  • julie 6:23 pm on June 10, 2015 Permalink
    Tags: data study   

    52 emails sent to people for my Data Vocab pilot survey.

     
  • julie 2:04 pm on June 10, 2015 Permalink  

    How Data Became a New Medium for Artists – The Atlantic.

    Some good data artists referenced here.

     
  • julie 3:57 pm on June 9, 2015 Permalink
    Tags:   

    Build your own Data Cloud – QMUL

    UPLOAD SLIDES

    MapReduce / Hadoop on RaspberryPi

    If your data is processed once, maybe not keep it in the HFDS as it is slow(?) check. HDFS (Hadoop Distributed File SYstem).

    Name Nodes store the metadata
    Data Nodes store data (nodes are replicated a number of times (3 usually)

    In nano hadoop-2.6.0/etc/hadoop/hadoop-env.sh (configuration file)
    Edit the java implementation to use.
    export JAVA_HOME=${JAVA_HOME}
    to
    export JAVA_HOME=”/home/pi/ejdk1.8.0_33/linux_armv6_vfp_hflt/jre/” [or equiv]

    edit core-site.xml

    fs.defaultFS
    hdfs://pi-0:9000 <--- this is the master node. you have to place the tag inside the

    edit hdfs-site.xml
    dfs.replication
    1
    dfs.namenode.name.dir
    /home/pi/had-hdfs/
    dfs.datanode.data.dir
    /home/pi/had-hdfs/

    edit mapred-site.xml <--- may already be correctly edited mapreduce.framework.name
    yarn

    Yarn
    – hadoop-2.6.0/etc/hadoop/yarn-site.xml

    yarn.nodemanager.aux-services mapreduce_shuffle yarn.resourcemanager.hostname
    localhost
    <---- localhost uses localhost as master. for NME ask ITS for the master IP on their Hadoop set-up  You need to start Hadoop process form the Master node... You need to start Yarn process form the Master node... [so both of these will be running at QMUL already] This was a SHIT workshop. to unzip tars in command line: tar xzvf [filename]

     
  • julie 3:53 pm on June 2, 2015 Permalink
    Tags:   

    Installing software on the RPi 2 for testing the receivers:

    Install node and node-red
    $ curl -sL https://deb.nodesource.com/setup | sudo bash –

    $ sudo apt-get install -y build-essential python-dev python-rpi.gpio nodejs

    $ sudo npm install -g –unsafe-perm node-red

    src [http://nodered.org/docs/hardware/raspberrypi.html]

    Mainly using node-red in the first instance to test the serial port stuff as it’s so quick and easy. Will end up using python for the final version.

    Working out power for all 7 readers:
    Tested in the lab with a variable power supply.
    each reader uses about 300mAh at 9v (they are usually powered by a 9v alkaline battery)
    For 7 I need a 3A 9V plug-in power supply, and can then wire they all together into one source.
    Ordered one plus a load of speaker cable to extend the power of each reader.

     
  • julie 12:04 pm on June 2, 2015 Permalink  

    Big Data and Humanitarian Response 

    Digital Humanitarians

    HOW BIG DATA IS CHANGING

    THE FACE OF HUMANITARIAN RESPONSE

    via Book | iRevolutions.

     
  • julie 10:35 am on June 2, 2015 Permalink
    Tags: conference   

    IEEE VISAP – conference 

    IEEE VIS 2015 Arts Program.

    Paper for the data vocabulary

    Artwork submission – We Need Us

     
  • julie 5:31 pm on June 1, 2015 Permalink  

    Train timetables – working and active 

    The train timetables exist in two forms – working (set about every 6 months) and active (updated in real-time about an hour ahead). This site is a good example of where both data sets are used and accessible.

    Realtime Trains | 1L47 1550 London Waterloo to Gillingham (Dorset).

     
  • julie 9:00 am on June 1, 2015 Permalink  

    rotating plinth for objects 

    10cm mains/battery turntable.

    Could use these as an added component to the system – data driven turning linked to a behaviour

     
  • julie 5:40 pm on May 27, 2015 Permalink
    Tags: ,   

    Hardware set-up today

    Download Raspian
    Install raspian on the RPi
    Install wifi dongle
    Problems getting onto Eduroam.

    Will need to get the Pi on the network with a fixed IP

     
  • julie 1:36 pm on May 27, 2015 Permalink  

    Orange Data Mining 

    Orange Data Mining.

    Tool for visualising diff data mining techniques

     
  • julie 8:57 am on May 27, 2015 Permalink
    Tags: ,   

    Tutorial – Learn Python in 10 minutes – Stavros’ Stuff.

    PySerial

    python tutorials and resources

     
  • julie 10:11 am on May 20, 2015 Permalink
    Tags: Ashby, , , zooniverse   

    William Ross Ashby: Intelligence Amplification 

    About selection and problem solving. How making a good choice is how we progress in all things. What happens when we have no choice? What happens when we make a ting choice and that is feeding into a bigger choice (voting, zooniverse, etc)? With some of these things we don’t know the end choices, we can only make the one that is in front of us here and now. Like bird and fish we can shoal without a goal.

    William Ross Ashby: Intelligence Amplification[edit]

    The term intelligence amplification (IA) has enjoyed a wide currency since William Ross Ashby wrote of “amplifying intelligence” in his Introduction to Cybernetics (1956). Related ideas were explicitly proposed as an alternative to Artificial Intelligence by Hao Wang from the early days of automatic theorem provers.

    ..”problem solving” is largely, perhaps entirely, a matter of appropriate selection. Take, for instance, any popular book of problems and puzzles. Almost every one can be reduced to the form: out of a certain set, indicate one element. … It is, in fact, difficult to think of a problem, either playful or serious, that does not ultimately require an appropriate selection as necessary and sufficient for its solution.

    It is also clear that many of the tests used for measuring “intelligence” are scored essentially according to the candidate’s power of appropriate selection. … Thus it is not impossible that what is commonly referred to as “intellectual power” may be equivalent to “power of appropriate selection”. Indeed, if a talking Black Box were to show high power of appropriate selection in such matters — so that, when given difficult problems it persistently gave correct answers — we could hardly deny that it was showing the ‘behavioral’ equivalent of “high intelligence”.

    If this is so, and as we know that power of selection can be amplified, it seems to follow that intellectual power, like physical power, can be amplified. Let no one say that it cannot be done, for the gene-patterns do it every time they form a brain that grows up to be something better than the gene-pattern could have specified in detail. What is new is that we can now do it synthetically, consciously, deliberately.

    Ashby, W.R., An Introduction to Cybernetics, Chapman and Hall, London, UK, 1956. Reprinted, Methuen and Company, London, UK, 1964.

    via Intelligence amplification – Wikipedia, the free encyclopedia.

     
  • julie 8:45 am on May 20, 2015 Permalink
    Tags: AI, , , licklider   

    Man-Computer Symbiosis paper by Licklider 

    “Man-Computer Symbiosis” is a key speculative paper published in 1960 by psychologist/computer scientist J.C.R. Licklider, which envisions that mutually-interdependent, “living together”, tightly-coupled human brains and computing machines would prove to complement each other’s strengths to a high degree:

    Man-computer symbiosis is a subclass of man-machine systems. There are many man-machine systems. At present, however, there are no man-computer symbioses. The purposes of this paper are to present the concept and, hopefully, to foster the development of man-computer symbiosis by analyzing some problems of interaction between men and computing machines, calling attention to applicable principles of man-machine engineering, and pointing out a few questions to which research answers are needed. The hope is that, in not too many years, human brains and computing machines will be coupled together very tightly, and that the resulting partnership will think as no human brain has ever thought and process data in a way not approached by the information-handling machines we know today.

    Licklider, J.C.R., “Man-Computer Symbiosis”, IRE Transactions on Human Factors in Electronics, vol. HFE-1, 4-11, Mar 1960.

    In Licklider’s vision, many of the pure artificial intelligence systems envisioned at the time by over-optimistic researchers would prove unnecessary. (This paper is also seen by some historians as marking the genesis of ideas about computer networks which later blossomed into the Internet).

    via Intelligence amplification – Wikipedia, the free encyclopedia.

    The above quote (my emphasis) is a good segway into the idea of us learning about our objects. Symbiosis is both ways – not just one way (i.e. man dictating to everything else). What does it mean to become highly familiar with our materials, our environment and our actions on and in them? What will come out of this new symbiotic closeness?

     
  • julie 6:51 pm on May 19, 2015 Permalink
    Tags:   

    Data Storage at QMUL – meeting with Tim Kay.
    Agreed that MySQL will probably be adequate for my needs. We calculated that the basic data (ID, scannerID, timestamp) would total about 10 Gb over 10 years. The data can be hosted on EECS as the whole lot will eventually be centralised and stored at IBM, so SBCS will have access in the future.
    I can serve webpages for the front end, and will be able to use QMUL authentication for a web form that can be used to store the NMR measurements and so on, also accessible by Chris and his team.
    I can have a separate domain name, but this may expire – would be better to have something that qmul will keep going … I like The Naked Mole Rat Diaries… and could buy a ten year domain, but need to think about this further.
    Also should be fine to run a live stream of the data through an API (I will need this for my work anyway).
    Regarding data privacy we think there is no issue as no personal (human) details stored.
    Consider having a back-up / mirror of the data too (i.e. Amazon Cloud if they can give a free academic license? and can they provide a real-time feed?)

    Powering the receivers – Ho suggests we wire them together and use a single power block that gives us 9v. We’re going to rig a few up and see what power they require on continuous read in the lab. Need to check that the current will be enough for all of them.
    Ho also has an old UPS that I can have for the project – it needs new batteries, but that should be a cheaper option than getting a new one. Need to check if it is noisy for the NMRs.

    Ordered the serial hub, power surge extension with USB and other bits. The hub will power the RPi, or it can be plugged directly into the power extension. This might be best. Also gives me some 5v ports to play with for any additional sensors.

    Software will be written in Python, need to look into the local DB i.e.: https://oss.oetiker.ch/rrdtool/

    NMR colony 800 map 20150519v1

     
  • julie 6:16 pm on May 18, 2015 Permalink
    Tags: , epsrc,   

    EPSRC research data principles 

    Research data:
    https://www.epsrc.ac.uk/about/standards/researchdata/
    “The expectations arise from seven core principles which align with the core RCUK principles on data sharing. Two of the principles are of particular importance: firstly, that publicly funded research data should generally be made as widely and freely available as possible in a timely and responsible manner; and, secondly, that the research process should not be damaged by the inappropriate release of such data.”

    Research data principles: https://www.epsrc.ac.uk/about/standards/researchdata/principles/ (accessed 18th May 2015
    EPSRC’s Charter is to support high-quality basic, strategic and applied research and related post-graduate training in engineering and the physical sciences, and to communicate and disseminate the resulting outcomes and knowledge. As such, EPSRC believes that the following guiding principles, which are aligned with the agreed RCUK principles on sharing of research data, should inform all decisions relating to the management of all research data that has arisen as a result of EPSRC funding:

    EPSRC-funded research data is a public good produced in the public interest and should be made freely and openly available with as few restrictions as possible in a timely and responsible manner.
    EPSRC recognises that there are legal, ethical and commercial constraints on release of research data. To ensure that the research process (including the collaborative research process) is not damaged by inappropriate release of data, research organisation policies and practices should ensure that these constraints are considered at all stages in the research process.
    Sharing research data is an important contributor to the impact of publicly funded research. To recognise the intellectual contributions of researchers who generate, preserve and share key research datasets, all users of research data should acknowledge the sources of their data and abide by the terms and conditions under which they are accessed.
    EPSRC-funded researchers should be entitled to a limited period of privileged access to the data they collect to allow them to work on and publish their results. The length of this period will depend on the scientific discipline and the nature of the research.
    Institutional and project specific data management policies and plans should be in accordance with relevant standards and community best practice and should exist for all data. Data with acknowledged long term value should be preserved and remain accessible and useable for future research.
    Sufficient metadata should be recorded and made openly available to enable other researchers to understand the potential for further research and re-use of the data. Published results should always include information on how to access the supporting data.
    It is appropriate to use public funds to support the preservation and management of publicly-funded research data. To maximise the scientific benefit which can be gained from limited budgets, the mechanisms for managing and providing access to research data should be both efficient and cost-effective in the use of such funds.

     
  • julie 3:34 pm on May 18, 2015 Permalink
    Tags:   

    Friday 8th May – tested the MiniTracker II [https://www.avidid.com/products/minitracker-i but with an RS232 cable] device with the NMR colony and received adequate readings from nearly all critters that passed through the tube.

    The device does need resetting periodically – testing the timeout on this there appears to be no logical pattern, so as it is a low overhead I’ll send a character to each reader every 30 secs, and test this.
    How to test?

    • Establish the mean average frequency between readings
    • Look for a number of segments of time when no data is coming from the device, that is above this average frequency.

    Last week a total of six trackers were ordered and paid for. There is a possibility that we need an extra one if we want to establish time spent within the tubes and within each housing element.

     
  • julie 2:53 pm on May 18, 2015 Permalink  

    PLOS ONE: A Distinct Role of the Queen in Coordinated Workload and Soil Distribution in Eusocial Naked Mole-Rats 

    PLOS ONE: A Distinct Role of the Queen in Coordinated Workload and Soil Distribution in Eusocial Naked Mole-Rats.

     
  • julie 1:59 pm on May 15, 2015 Permalink
    Tags: , quantified self   

    LAURIE FRICK | Walking, Eating, Sleeping 

    LAURIE FRICK | Walking, Eating, Sleeping.

    “Numbers are abstract concepts but we recognize pattern intuitively. I’m experimenting with wall size patterns that anticipate the condition of our daily-selves. Very soon walls and spaces we occupy will be filled with easy to decode patterns – a visual record of how we feel, stress level, mood, bio-function captured, digitally recorded and physically produced using 3D printers and lasercutters. Human data portraits transcribed as pattern from the all the sensor data collected about us.

    Will it kill the mystery of being human, simply magnify our defects or will sensors and a mass of measurements acknowledge and present patterns of self-examination that lure us into a future of self-quantification that is irresistible?” – Laurie Frick

    “Walking, Eating, Sleeping” show at Oklahoma Contemporary Jun 11-Aug 23, 2013 and Marfa Contemporary Sep 10-Jan 3, 2014

    Biog:
    Laurie Frick is a data artist exploring patterns of self-tracking…sensors, surveillance, what will it all mean? Using her background in high-technology she offers an alternative view of privacy and a glimpse into a future of the data-selfie with handmade installations from her personal data. FRICKbits ‘your data is now art on your phone’ was crowdfunded with a successful Kickstarter campaign and is now in the Apple store.

    http://www.lauriefrick.com/

    Also FrickBits – data art on your phone

     
  • julie 11:38 am on May 14, 2015 Permalink
    Tags:   

    Degenerate hearing and sound localization in naked mole rats (Heterocephalus glaber), with an overview of central auditory structures. – PubMed – NCBI.

     
  • julie 11:36 am on May 14, 2015 Permalink  

    Molecular evolution of the hyaluronan synthase 2 gene in mammals: implications for adaptations to the subterranean niche and cancer resistance | Biology Letters 

    Molecular evolution of the hyaluronan synthase 2 gene in mammals: implications for adaptations to the subterranean niche and cancer resistance | Biology Letters.

     
  • julie 11:35 am on May 14, 2015 Permalink  

    COUNTING IN EIGHT, MOVING BY COLOR – Program – KW Institute for Contemporary Art 

    COUNTING IN EIGHT, MOVING BY COLOR – Program – KW Institute for Contemporary Art.

    Tim Structure Composition # III

     
  • julie 12:56 pm on May 13, 2015 Permalink
    Tags:   

    OpenSensors.io training 

    IoT with OpenSensors – 28 April 2015

    IoT deep dive with OpenSensors https://opensensors.io/

    Node-RED – plumbing system for iot. nodered.org (opensource but developed at IBM Emerging Technology)

    @BorisAdryan

    node.js based webservice on various platfroms – Rpi, mac, cloud…

    • website with GUI
    • large library
    • flows shared as JSON strings

    http://flows.nodered.org

    Node.js is a prerequirement, then run

    > sudo npm install -g node-red

    > node-red

     

    Access the interface at http://localhost:1880/

    About 100 extra nodes on npmjs

    IBM have a cloud version on Bluemix https://console.ng.bluemix.net

    • If the serial port is picking up extra broadcasts from other Pi’s:

    sudo nano /etc/inittab

    comment out the line (using a hash) with ttyAMA0

    sudo nano /boot/cmdline

    delete the reference to ttyAMA0

    ====

    REFS & TERMS:

    Data communication protocol – MQTT.org

    MQTT is designed for M2M, connects via TCP, very lightweight for sending small packets of data. HTTP has big headers.

    OpenSensors is a MQTT broker. Each part of the system is autonomous – the sensor sending doesn’t care where the data is going, the broker doesn’t care where data is from, the user … etc.

    Notes to create basic node-red io’s: http://www.slideshare.net/BorisAdryan/node-red-coursecamjamjuly2014

    Payload – is the thing/data you are sending (can be JSON, PDF, whatever)

    COAP – HTTP lite, avoid headers but use GET and POST  HTTP-like requests. http://coap.technology/

    opensensors.io

    user: misslake pp: usual33 e: misslake@lubric.com

    • client ID: 1321. pp: 8SbXhPdT

    SSE’s  (which OpenSensors uses) get through firewalls more easily than websockets. RESEARCH this.

    ===

    Machine Learning

    supervised learning – classification and regression

    dimensionality reduction

    deep learning

    unsupervised learning – xxx and xxx

    hierarchical clustering (split into pairs and see what we end up with)

    • build distance matrix on basis of correlation coefficient (cc)
    • build tree

    k-means clustering

    • finds the optimum clustering for you, starting from a set of n starting conditions.
    • K is optimum number of clusters in the set

    Support vector machine – train the data, get suggestion for grouping, present new data

    Random forests – find the shortest tree that gets me to my data (classifications)

    Outlier prediction through regression

    cassandra – open sensors stores data.

    For longevity, in 10 years say…

    • will the data from inferior hardware still be comparable to the latest precision hardware?
    • give all your data as much metadata as possible for longevity (hardware versions, softwares, etc)

    The concrete embedded sound sculpture… layers under layers under layers. Bio, concrete, plastic, PLA, metal, alloys, … The time is now. write up with Gavin. Climate change. Disposible culture. Noise pollution. Wifi. Electronic material world. Nature as technology. (+ collaborator from materials lab? Zoe XX?)

    Yodit is sending notes on Python data analysis (uses iPython)

    $ killall -# screen   (where # is the number of screens open)

    NMRTracker Flow

    [{“id”:”2b3c023e.d4c3fe”,”type”:”serial-port”,”serialport”:”/dev/cu.usbserial”,”serialbaud”:”9600″,”databits”:”8″,”parity”:”none”,”stopbits”:”1″,”newline”:”A”,”bin”:”false”,”out”:”char”,”addchar”:true},{“id”:”be7e25f7.4181d8″,”type”:”debug”,”name”:””,”active”:true,”console”:”false”,”complete”:”payload”,”x”:624,”y”:142,”z”:”afb085ff.504f78″,”wires”:[]},{“id”:”68e6ebb4.971914″,”type”:”serial in”,”name”:”minitracker”,”serial”:”2b3c023e.d4c3fe”,”x”:127,”y”:165,”z”:”afb085ff.504f78″,”wires”:[[“6c493c2d.93b6c4”]]},{“id”:”6c493c2d.93b6c4″,”type”:”function”,”name”:”str.search”,”func”:”var str = msg.payload;\nvar n = str.search(\”806\”);\nif (n == -1){\n    msg.payload = \”nmr01\”;\n} else {\n    msg.payload = \”nmr02\”;    \n}\nreturn msg;”,”outputs”:1,”valid”:true,”x”:320,”y”:188,”z”:”afb085ff.504f78″,”wires”:[[“d960f09e.269f1”]]},{“id”:”d960f09e.269f1″,”type”:”delay”,”name”:””,”pauseType”:”delay”,”timeout”:”1″,”timeoutUnits”:”seconds”,”rate”:”1″,”rateUnits”:”second”,”randomFirst”:”1″,”randomLast”:”5″,”randomUnits”:”seconds”,”drop”:false,”x”:477,”y”:234,”z”:”afb085ff.504f78″,”wires”:[[“be7e25f7.4181d8”]]}]

    NMRTracker Flow 20150508

     
  • julie 9:41 am on April 28, 2015 Permalink
    Tags:   

    IoT deep dive with OpenSensors https://opensensors.io/

    Node-RED – plumbing system for iot. nodered.org
    @BorisAdryan

    node.js based webservice on various platfroms – Rpi, mac, cloud…

    • website with GUI
    • large library
    • flows shared as JSON strings
     
  • julie 3:44 pm on February 20, 2015 Permalink  

    This week:
    RFID system. New papers and insight from Susan Imberman and Dan McCloskey (CUNY) about their RFID tracking systems. They are willing to share the data they have, in real-time too when it’s ready.
    TO DO: read papers carefully and ascertain what kind of analysis they are using and how relevant, if at all, to us.

    Contacted Pet Detect who have a universal scanner that detects AVID tags. They are quoting for a system.
    Plan B is to get Mike Harrison to build it. I am happy to just pay for this and get it installed, would rather focus on the software framework, which needs to be reusable and future proof, initial specifications developing here: https://docs.google.com/document/d/1mgJJ2LX2fCUtRphFdgwWl2YxhFc5v-MTgbadHfOahGE/edit

    MATERIALS:
    Skylar Tibbets et al – paper on active 3D printed materials. Thoroughly assessed this and am exploring how this technique can be used to activate the objects, would be best if not water activated but electrically conductive / heat responsive. Heat response material probably faster than the water expansion, and much more precision to target small areas.

    In the paper, the author talks about self-evolving structures, which gives too much importance to the relatively simple motion driven by a state change. The object moves to a position and then returns to its start point. Self-transformation (used on page 5) is also not strictly true as the material changes in response to an environmental change, it doesn’t come from within itself. Anyway.

    How can I combine a data-driven response with an object that has some innate movement? Does the data become a trigger, a time of activation? or permission for the thing to move? Would it be the ‘life’ in the object – i.e. without a data stream this object is inert (dead) even with it’s potential. Could the data affect the environmental conditions that the objects exist in as well as sending/modulating electrical signals?

    The objects fabricated in these experiments are multi-materials embedded in a 3D structure. One material acts as a rigid core and the expanding (state-changing) material is positioned in such a way that when it expands it deforms the rigid sections. They refer to this as a Digital Material [http://www.stratasys.com/materials/polyjet/digital-materials] – a material that can be adjusted digitally (in terms of physical structure).

    INTELLIGENT ENVIRONMENTS (lecture notes)
    “The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it.”
    — Mark Weiser’s “The Computer for the Twenty-First Century” (Scientific American, 1991, pp. 66–75)

    Intelligent Environments Manifesto – ref Augusto, Callaghan 2013 — in manifesto – one point says “to work under the principal that the user is in command” – WHY? Do we not need to relinquish control? How can we possibly command of something that we don’t know about? Yes these sensors can oversimplify reality but they bring to our attention more that we would OVERTLY think about usually… this is more complex?

    ETHICAL ISSUES in (PRODUCT) DESIGN
    NMR – what are the ethical issues to consider – can an object move in a subliminal way that make you feel awkward or at ease or stressed? How can these behaviours be recognised? Do we need to control for this if we are assuming the object is just communicating for it’s source. How far do we go in censoring the data? What are the ethical issues of data manipulation from a real-time stream of life data?

     
  • julie 9:41 pm on February 15, 2015 Permalink  

    Body Language of Objects:
    Great chat with Geraint about positioning the thesis around this title and concept.
    Found some refs, but these both looking at different things. I’m interested in the actual body language of the object via data-driven movement:
    http://www.chrisnatt.com/project/bodylanguage/
    https://books.google.co.uk/books?id=iQnfJHjcVQ8C&pg=PA56&lpg=PA56&dq=%22body+language+of+objects%22&source=bl&ots=rnfcGKr0gJ&sig=h0qW13Mmh-LiO-8ufGDDsdOGVgc&hl=en&sa=X&ei=XwPhVMGwFIrfaK71gHg&ved=0CCwQ6AEwAg#v=onepage&q=%22body%20language%20of%20objects%22&f=false

    GS: Cortexual not contextual.

     
  • julie 9:39 pm on February 15, 2015 Permalink  

    Stats assignment 01 (mostly fiction):
    Julie_Freeman_POLM036_20150213

    this helps with choice of variable and tests: http://www.statsdirect.com/help/default.htm#methods/relationship_two_variables_measured_on_same_group.htm

    My notes:
    The null hypothesis is that there is NO association between the two variables. (i.e. women are not more likely to vote left than men)

    We want to measure the significance of the association between varX and varY – do this using chi-squared test).
    The closer to 1 means the LESS significant the relationship. Use for for category variables — i,e, gender vs the scale
    In SPSS, the column marked Asymp. Sig. (2-sided) is the P value

    P (probability) value breakdown:

    P > 0.10 No evidence against the null hypothesis. The data appear to be consistent with the null hypothesis.
    0.05 < P < 0.10 Weak evidence against the null hypothesis in favor of the alternative. 0.01 < P < 0.05 Moderate evidence against the null hypothesis in favor of the alternative. 0.001 < P < 0.01 Strong evidence against the null hypothesis in favor of the alternative. P < 0.001 Very strong evidence against the null hypothesis in favor of the alternative. We want to measure the strength and direction of the relationship using correlation coefficients direction can be positive or negative (tendency) strength is (i think ) the outcome of the Pearson or Spearman or other test:

    • Pearson’s R – interval (scale) variables [use this for age vs L-R scale, do not use with gender]
    • Spearman’s Rank – ordinal (ordered) variables

    correlations: -1, 0, +1 (towards either end of scale (closer to 1/-1) = stronger relationship, signs indicate the direction NOT the strength)

     
  • julie 1:36 pm on February 12, 2015 Permalink  

    Discovered paper of RFID tracking NMR, asked them to help explain the tech set-up. Paper not actually very insightful.

    Kinetic Objects:
    Think about how to collaborate with MIT on the programmable materials work – data-driving the materials from NMRs. With Skylar Tibbets
    http://www.selfassemblylab.net/ProgrammableMaterials.php
    http://www.nature.com/srep/2014/141211/srep07422/full/srep07422.html

    Statistics:
    Reading books on stats methods etc for SPSS

     
  • julie 5:41 pm on February 10, 2015 Permalink
    Tags: , , social network   

    NMR scanning:
    when the data finally comes in, check this paper Social network analysis: A methodological introduction by Butts.

     
  • julie 5:21 pm on February 10, 2015 Permalink  

    Ontologies:

    Linked Open Vocabularies – http://lov.okfn.org/dataset/lov/ a collection of ontologies about all sorts. Godo reference point for linked data bits. The ‘thing’ that I develop needs to be linked and in a correct format (RDF?) so it is machine as well as human usable.

    http://www.w3.org/ns/ma-ont is a media ontology but does not cover the data as a material description that I am after.

    The dublin core metadata terms has a great range of terms to be used: http://dublincore.org/documents/2012/06/14/dcmi-terms/ I think that the data art set should use terms from this but in an easy to use list with vocabularies. This could be in the same format as the Getty stuff perhaps.

    The key issue is that there are many many ontologies, taxonomies and vocabularies to use, and as data sits behind all of the areas at some point, it is hard to choose a labelling standard. The data art model is a suggestion for ensuring that some basic data properties are captured and noted at the delivery of the work.

    Do I make a small ontology just specifically for use with Data as an Art Material? Or will a simple table suffice? Do the relationships matter? And how would an artist then use the ontology? How to get the artists and the cataloguer to use the same things – does it matter? is it the artists job, or would the curator/classifier do this?

     
c
Compose new post
j
Next post/Next comment
k
Previous post/Previous comment
r
Reply
e
Edit
o
Show/Hide comments
t
Go to top
l
Go to login
h
Show/Hide help
shift + esc
Cancel